-- Logs begin at Tue 2022-06-21 15:40:00 UTC, end at Tue 2022-06-21 17:08:15 UTC. -- Jun 21 16:39:38.582814 dv-cinder-799871-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 16:39:38.591979 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 16:39:38 2022] *** Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: nodename: dv-cinder-799871-21-iscsi Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: machine: x86_64 Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: clock source: unix Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: pcre jit disabled Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: detected number of CPU cores: 4 Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: current working directory: / Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: detected binary path: /usr/bin/uwsgi-core Jun 21 16:39:38.594111 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: your processes number limit is 47680 Jun 21 16:39:38.594776 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: your memory page size is 4096 bytes Jun 21 16:39:38.594776 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: detected max file descriptor number: 2048 Jun 21 16:39:38.594776 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: lock engine: pthread robust mutexes Jun 21 16:39:38.594776 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: thunder lock: enabled Jun 21 16:39:38.594776 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 16:39:38.594776 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 16:39:38.640570 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: Python main interpreter initialized at 0x55f5e73cb9c0 Jun 21 16:39:38.640570 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: python threads support enabled Jun 21 16:39:38.640570 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: your server socket listen backlog is limited to 100 connections Jun 21 16:39:38.640570 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: your mercy for graceful operations on workers is 90 seconds Jun 21 16:39:38.640949 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 16:39:38.641026 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: *** Operational MODE: preforking *** Jun 21 16:39:38.641245 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: *** uWSGI is running in multiple interpreter mode *** Jun 21 16:39:38.641245 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: spawned uWSGI master process (pid: 110302) Jun 21 16:39:38.641449 dv-cinder-799871-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 16:39:38.642681 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: spawned uWSGI worker 1 (pid: 110303, cores: 1) Jun 21 16:39:38.642681 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: spawned uWSGI worker 2 (pid: 110304, cores: 1) Jun 21 16:39:38.642681 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 16:39:39.317194 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 16:39:39.317822 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 16:39:40.483863 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:39:40.483863 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: from cryptography.utils import int_from_bytes Jun 21 16:39:40.484562 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:39:40.484562 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: from cryptography.utils import int_from_bytes Jun 21 16:39:40.484681 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:39:40.484681 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: from cryptography.utils import int_from_bytes Jun 21 16:39:40.485057 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:39:40.485057 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: from cryptography.utils import int_from_bytes Jun 21 16:39:43.059915 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 16:39:43.060510 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 16:39:43.060743 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 16:39:43.061113 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 16:39:43.061400 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 16:39:43.061799 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.062165 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.062492 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.062814 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.063148 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.063464 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.063788 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.064112 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.064443 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.064709 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.065025 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.065394 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-21-iscsi {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.065716 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.066028 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.066340 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.066662 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.066971 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.067294 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.067604 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.068737 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.069193 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.069529 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.069861 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.070285 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.070609 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.070928 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.071256 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.071570 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.071899 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.072210 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.072620 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-21-iscsi {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.073083 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.073445 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.073769 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.074191 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.074506 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.074819 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.075153 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.075479 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.075787 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.076117 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.076559 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.076884 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.077207 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.077544 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.077857 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.078175 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.078505 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.078817 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.079127 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.079384 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.079698 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.080047 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.080341 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.080678 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 16:39:43.081389 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.081389 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.081535 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 16:39:43.081611 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.081611 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.081843 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.081940 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 16:39:43.082088 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.084162 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.084274 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 16:39:43.084358 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.084449 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 16:39:43.084530 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.084660 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.084743 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.084867 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.084984 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.085125 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.085257 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.085427 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.085607 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.085907 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.086003 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.086390 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.086477 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.086727 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.086980 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.087078 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.087321 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.087407 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.087754 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.087858 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.088014 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.088153 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.088327 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.088488 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.088675 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.088831 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-21-iscsi {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.088999 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.089167 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.089336 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.089515 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.089666 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.089837 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.089991 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.090175 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.090304 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.090496 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.090616 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.090824 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.090911 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.091137 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.091225 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.091560 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.091663 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.091868 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.092036 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.092143 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.092430 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.092568 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.092725 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.093046 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.093133 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.093379 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.093692 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.093777 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.094003 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.094302 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.094399 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.094608 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.094700 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.094917 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.095004 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.095227 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.095364 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.095536 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.095679 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.095846 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.096154 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.096254 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.096465 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.096771 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.096953 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-21-iscsi {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.097077 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.097375 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.097467 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.097703 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.097803 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.098026 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.098114 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.098336 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.098643 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.098797 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.098973 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.100111 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.100263 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.100410 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.100559 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.100704 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.100890 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.101029 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.101360 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.101449 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.101673 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.101985 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.102074 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.102292 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.102550 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.102638 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.102910 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.103107 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.103216 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.103525 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.103657 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.103844 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.104155 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.104252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.104463 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.104734 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.104821 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.105062 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.105271 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.105443 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.105692 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.105845 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.105997 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.106303 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.106402 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.106606 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.106922 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.107009 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.107227 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.107456 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.107552 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.107837 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.107923 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.108145 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.108429 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.108532 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.108803 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.109003 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.109139 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.109514 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.109604 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.109839 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.110143 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.110233 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.110501 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.110587 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.110851 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.111028 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.111400 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.111500 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.111742 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.111989 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.112091 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.112387 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.112555 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.112859 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.112955 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.113205 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.113461 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.113552 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.113869 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.114002 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.114195 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.114332 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.114532 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.114682 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.115008 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.115094 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.115344 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.115491 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.115670 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.115763 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.116004 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.116091 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.116324 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.116412 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.116652 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.116740 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.117067 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.117165 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.117429 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.117532 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.117746 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.117835 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.118092 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.118179 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.118417 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.118513 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.118744 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.118831 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.119079 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.119179 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.119399 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.119494 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.119709 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.119796 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.120020 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.120106 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.120328 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.120423 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.120652 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.120746 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.120992 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.121220 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.121356 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.121570 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.121780 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.121907 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.122113 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.122202 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.122460 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.122749 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.122982 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.123076 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.123312 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.123399 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.123639 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.123727 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.123951 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.124036 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.124262 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.124356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.124595 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.124694 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.124906 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.124994 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.125218 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.125332 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.125559 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.125693 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.125869 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.125957 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.126180 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.126276 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.126489 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.126620 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.126798 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.127120 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.127205 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.127443 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.127745 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.127833 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.128053 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.128252 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.128555 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.128658 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.128894 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.129146 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.129238 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.129561 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.129717 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.130037 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.130134 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.130470 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.130774 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.130871 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.131209 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.131309 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.131522 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.131615 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.131843 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.131931 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.132153 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.132395 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.132484 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.132778 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.133000 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.133088 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.133412 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.133673 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.133769 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.134058 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.134224 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.134382 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.134697 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.134791 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.135029 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.135262 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.135349 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.135649 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.135782 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.135972 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.136290 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.136401 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.136612 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.136820 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.136917 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.137232 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.137387 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.137591 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.137914 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.138002 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.138234 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.138458 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.138583 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.138921 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.139007 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.139235 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.139521 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.139609 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.139886 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.140039 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.140211 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.140523 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.140610 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.140839 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.141109 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.141196 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.141507 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.141608 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.141963 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.142234 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:39:43.142338 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.142582 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.142860 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.142963 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.143190 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.143284 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.143501 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.143598 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.143812 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.143908 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.144140 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.144227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.144454 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.144542 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.144765 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.144861 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.145071 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.145202 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.145404 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.145558 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.145751 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.146421 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.146590 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.148065 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.148560 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.148661 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.148757 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.148848 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.148930 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149016 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149106 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149187 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149299 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149384 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149477 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149559 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149645 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149733 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149813 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149892 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.149970 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.150056 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.150143 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.150235 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.150325 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.150485 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.150573 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.150810 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.151068 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.151164 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.151434 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.151522 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.151788 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.151876 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.152280 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.152374 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.152595 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.152684 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.152920 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.153007 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.153267 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.153405 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.153632 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.153719 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.153959 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.154046 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.154285 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.154373 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.154597 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.154692 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.154917 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.155008 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.155230 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.155319 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.155546 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.155634 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.155861 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.155956 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.156177 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.156485 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.156573 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.156799 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.157080 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.157177 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.157447 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.157642 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.157777 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.157968 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.158092 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.158316 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.158405 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.158688 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.158777 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.159018 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.159278 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.159374 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.159674 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.159880 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.159974 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.160242 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.160331 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.160593 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.160680 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.160907 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.161054 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.161223 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.161628 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.162342 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.162555 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.162771 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.162919 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.163131 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.163289 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.163419 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.163598 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.163917 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.164021 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.164238 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.164338 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.164573 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.164659 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.164888 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.164975 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.165209 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.165512 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.165650 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.165840 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.165986 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.166147 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.166282 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.166464 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.166627 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.166770 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.166906 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.167221 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.167362 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.167580 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.167726 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.167902 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.168052 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.168218 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.168429 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.168563 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.168853 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.168985 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.169173 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.169517 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.169662 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.169837 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.169980 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.170148 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.170290 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.170462 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.170607 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.170775 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.170911 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.171090 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.171225 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.171410 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.171547 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.171725 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.171868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.172047 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.172183 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.172456 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.172605 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.172780 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.172925 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.173123 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.173255 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.173481 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.173572 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.173793 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.173888 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.174117 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.174202 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.174436 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.174524 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.174752 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.174840 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.175057 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.175156 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.175370 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.175456 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.175697 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.175782 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.176007 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.176233 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.176475 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.176786 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.176872 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.177155 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.177333 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.177513 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.177782 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.177934 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.178218 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.178307 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.178538 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.178636 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.178862 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.178949 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.179196 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.179283 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.179561 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.179789 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.179876 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.180133 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.180220 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.180459 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.180554 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.180787 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.180874 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.181116 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.181205 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.181484 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.181588 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.181811 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.181906 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.182142 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.182274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.182461 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.182784 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.182871 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.183100 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.183417 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.183507 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.183801 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.183890 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.184177 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.184372 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.184515 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.184816 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.184992 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.185131 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.185436 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.185727 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.185827 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.186075 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.186322 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.186418 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.186742 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.186903 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.187060 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.187379 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.187513 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.187689 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.187952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.188239 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.188327 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.188616 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.188846 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.188989 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.189226 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.189580 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.189669 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.189899 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.190165 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.190262 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.190538 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.190696 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.190851 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.191165 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.191264 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.191476 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.191763 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.191851 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.192121 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.192315 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.192450 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.192896 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.193009 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.193475 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.193660 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.193802 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.194013 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.194158 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.194345 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.194577 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.194720 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.194956 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.195131 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.195284 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.195570 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.195700 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.195888 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.196201 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.196290 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.196518 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.196740 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.196885 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.197139 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.197341 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.197576 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.197844 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.197991 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.198270 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.198459 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.198603 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.198900 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.199042 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.199215 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.199351 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.199528 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.199677 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.199843 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.199977 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.200140 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.200314 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.200454 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.200647 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.200783 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.200969 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.201062 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.201311 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.201421 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.201636 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.201724 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.201954 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.202050 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.202275 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.202372 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.202587 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.202672 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.202967 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.203059 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.203291 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.203392 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.203606 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.203693 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.203930 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.204017 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.204263 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.204357 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.204572 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.204668 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.204880 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.204966 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.205195 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.205323 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.205534 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.205631 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.205840 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.205927 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.206155 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.206243 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.206484 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.206579 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.206794 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.206889 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.207103 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.207205 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.207419 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.207664 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.207751 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.208028 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.208198 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.208885 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.209027 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.209200 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.209356 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.209539 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.209664 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.209856 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.210123 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.210221 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.210604 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.210720 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.210805 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.210893 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.211069 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.211167 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.211382 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.211486 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.211690 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.211798 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.212000 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.212094 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.212305 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.212400 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.212651 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.212746 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.212959 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.213054 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.213342 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.213450 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.213656 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.213758 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.213973 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.214065 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.214291 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.214384 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.214605 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.214700 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.214919 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.215019 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.215233 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.215327 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.215545 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.215663 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.215865 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.215957 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.216179 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.216271 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.216496 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.216652 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.216805 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.217117 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.217220 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.217480 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.217794 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.217888 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.218108 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.218431 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.218531 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.218757 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.218852 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.219084 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.219221 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.219407 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.219697 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.219820 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.220010 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.220322 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.220409 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.220643 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.220733 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.220946 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.221081 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.221259 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.221576 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.221666 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.221895 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.222209 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.222304 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.222521 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.222673 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.222830 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.222999 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.223142 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.223317 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.223451 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.223635 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.223759 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.224592 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.224691 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.225166 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.225328 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.225510 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.225614 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.225824 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.225923 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.226130 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.226217 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.226443 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.226543 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.226749 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.226838 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.227057 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.227186 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.227370 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.227504 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.227801 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.227898 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.228178 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.228422 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.228535 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.228803 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.228997 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.229194 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.229404 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.229729 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.229836 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.230050 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.230349 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.230445 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.230678 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.230781 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.230994 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.231089 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.231346 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.231440 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.231661 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.231833 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.231970 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.232071 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.232277 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.232367 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.232594 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.232697 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.232922 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.233012 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.233230 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.233380 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.233695 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.233808 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.234011 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.234100 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.234323 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.234410 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.234635 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.234731 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.234948 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.235035 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.235263 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.235372 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.235574 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.235687 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.235892 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.236053 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.236195 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.236402 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.236548 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.236724 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.236875 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.237008 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.237159 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.237377 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.237527 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.237760 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.237899 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.238079 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.238552 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.238691 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.238837 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.238979 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.239115 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.239205 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.239361 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.239538 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.239766 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.239901 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.240090 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.240397 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.240507 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.240742 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.240883 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.241017 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.241147 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.241324 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.241476 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.241645 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.241787 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.241980 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.242112 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.242277 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.242412 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.242588 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.242737 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.242899 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.243036 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.243228 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.243374 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.243544 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.243681 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.243855 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.243992 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.244165 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.244310 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.244480 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.244638 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.244792 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.244929 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.245102 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.245248 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.245443 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.245535 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.245771 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.245874 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.246094 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.246298 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.246388 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.246703 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.246877 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.247007 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.247335 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.247451 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.247749 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.247840 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.248126 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.248325 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.248427 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.248740 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.248906 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.249165 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.249261 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.249600 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.249780 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.249915 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.250228 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.250351 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.250681 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.250792 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.251014 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.251343 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.251437 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.251754 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.251842 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.252090 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.252367 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.252464 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.252742 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.252883 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.253203 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.253341 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.253547 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.253861 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.253948 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.254211 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.254456 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.254560 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.254839 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.255003 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.255723 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.256072 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.256167 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.256389 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.256631 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.256725 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.257047 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.257176 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.257397 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.257723 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.257811 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.258054 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.258300 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.258387 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.258665 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.258859 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.258985 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.259301 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.259403 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.259611 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.259920 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.260020 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.260232 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.260454 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.260545 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.260860 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.260963 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.261143 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.261522 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.261617 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264165 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264282 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264357 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264357 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264498 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264570 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264636 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264702 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264702 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264902 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.264981 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265057 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265125 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265199 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265267 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265376 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265448 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265515 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265581 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265654 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265721 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265796 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.265864 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.266449 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.266523 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.266590 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.266667 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.266742 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.266811 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.266878 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.266944 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.267176 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.267276 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.267529 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.267633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.267848 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.268077 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.268247 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.268393 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.268483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.268606 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.268770 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.268926 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.269102 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.269448 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.269541 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.269763 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.269865 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.270107 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.270420 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.270511 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.270736 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.270888 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.271657 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.271879 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.272013 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.272373 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.272615 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.272704 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.273003 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.273090 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.273345 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.273451 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.273664 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.273745 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.273980 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.274253 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.274342 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.274592 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.274680 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.274923 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.275018 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.275250 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.275340 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.275570 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.275663 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.275894 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.275995 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.276230 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.276360 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.276538 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.276627 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.276857 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.276954 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.277218 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.277379 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.277568 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.277657 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.277882 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.278029 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.278212 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.278306 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.278526 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.278615 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.278839 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.278971 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.279152 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.279253 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.279479 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.279568 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.279792 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.279925 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.280114 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.280375 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.280473 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.280728 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.281045 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.281140 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.281387 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.281719 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.281820 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.282056 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.282145 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.282380 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.282469 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.282695 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.282784 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.283013 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.283331 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.283427 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.283865 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.283955 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.284183 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.284381 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.284520 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.284720 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.284849 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.285081 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.285170 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.285513 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.285701 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.285836 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.286166 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.286276 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.286517 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.286777 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.287214 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.287328 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.287413 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.287490 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.287577 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.287744 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.287852 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.288065 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.288179 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.288401 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.288502 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.288735 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.288824 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.289057 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.289144 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.289403 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.289509 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.289838 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.289948 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.290172 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.290306 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.290500 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.290686 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.290995 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.291264 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.291408 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.291638 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.291858 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.291948 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.292251 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.292492 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.292595 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.292887 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.293077 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.293203 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.293493 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.293583 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.293834 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.293937 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.294153 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.294243 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.294473 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.294587 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.294787 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.294885 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.295102 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.295190 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.295414 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.295510 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.295723 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.295821 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.296037 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.296127 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.296350 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.296469 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.296751 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.296917 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.297077 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.297166 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.297450 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.297592 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.297746 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.297848 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.298064 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.298189 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.298375 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.298463 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.298687 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.298777 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.298996 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.299120 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.299306 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.299394 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.299620 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.299711 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.299997 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.300094 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.300312 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.300585 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.300734 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.300951 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.301040 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.301351 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.301457 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.301642 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.301746 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.301981 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.302187 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.302344 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.302549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.302670 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.302885 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.302977 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.303201 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.303312 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.303516 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.303618 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.303844 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.303933 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.304163 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.304251 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.304494 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.304591 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.304810 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.304898 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.305126 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.305221 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.305467 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.305567 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.305777 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.305866 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.306084 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.306350 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.306448 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.306693 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.306782 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.307001 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.307089 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.307326 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.307463 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.307639 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.307971 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.308062 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.308283 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.308591 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.308688 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.308962 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.309080 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.309431 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.309547 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.309768 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.310137 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.310233 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.310457 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.310602 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.310936 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.311042 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.311271 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.311588 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.311676 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.311985 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.312109 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.312310 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.312631 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.312726 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.312952 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.313168 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.313541 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.313642 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.313873 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.314144 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.314236 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.314486 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.314809 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.314896 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.315128 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.315363 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.315460 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.315787 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.315883 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.316114 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.316429 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.316526 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.316750 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.316980 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.317077 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.317407 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.317575 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.318263 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.318569 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.318891 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.319054 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.319217 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.319560 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.319674 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.319878 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.320188 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.320277 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.320621 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.320739 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.320941 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.321266 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.321386 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.321616 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.321840 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.321929 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.322244 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.322398 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.322572 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.322889 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.322976 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.323332 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.323420 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.323706 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.323974 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.324063 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.324375 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.324557 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.324709 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.324934 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.325030 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.325322 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.325416 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.325653 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.325753 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.325964 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.326052 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.326282 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.326370 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.326605 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.326701 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.326920 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.327009 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.327231 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.327326 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.327539 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.327667 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.327852 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.327997 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.328159 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.328318 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.328459 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.328734 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.328894 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.329064 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.329214 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.329414 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.329560 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.329746 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.329869 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.330067 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.330179 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.330392 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.330491 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.330715 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.330814 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.331060 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.331158 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.331365 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.331537 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.331677 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.331774 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.331985 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.332074 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.332294 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.332383 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.332599 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.332868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.332967 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.333201 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.334022 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.334258 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.334407 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.334610 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.334705 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.335064 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.335223 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.335361 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.335577 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.335719 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.335973 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.336123 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.336291 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.336439 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.336618 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.336757 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.336970 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.337106 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.337291 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.337438 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.337611 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.337772 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.337950 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.338110 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.338268 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.338446 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.338589 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.338744 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.338906 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.339062 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.339228 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.339379 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.339543 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.339707 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.339861 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.340040 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.340193 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.340368 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.340524 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.340683 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.340845 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.340993 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.341135 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.341331 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.341469 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.341794 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.341981 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.342123 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.342422 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.342591 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.342744 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.343056 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.343192 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.343368 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.343665 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.343796 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.343983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.344126 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.344297 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.344430 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.344615 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.344748 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.344934 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.345160 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.345324 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.345604 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.345796 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.345933 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.346235 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.346377 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.346562 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.346692 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.346886 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.347035 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.347214 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.347375 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.347564 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.347898 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.348042 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.348220 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.348395 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.348526 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.348719 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.348938 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.349101 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 16:39:43.349246 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.349591 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.350188 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.350526 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.350845 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.351163 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.351479 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.351800 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.352118 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.352432 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.352746 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.353057 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.353402 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.353863 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.354219 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.354537 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.354855 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.355284 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.355851 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.356416 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.356761 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.357081 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.357424 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.357760 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.358082 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.358418 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.358742 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.359064 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.359492 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.359824 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.360389 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.360734 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.361066 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.361474 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.361846 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.362173 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.362493 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.362809 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.363141 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.363464 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.363784 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.364128 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.364448 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.364917 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.365428 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.365750 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.366073 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.366392 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.366711 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.367028 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.367345 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.367659 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.367979 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.368327 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.368652 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.368998 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.369341 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.369674 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.369994 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.370313 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.370629 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.370947 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.371270 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.371604 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.371926 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.372237 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.372847 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.373475 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.374031 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.374366 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.374686 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.375017 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.375446 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.376040 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.376593 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.376919 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.377259 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.377632 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.378239 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.378821 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.379369 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.379899 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.380964 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.381540 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.382106 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.382647 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.383190 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.383732 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.384287 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.384821 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.385375 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.385907 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.386449 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.386986 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.387436 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.388029 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.388588 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.389102 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.389464 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.389791 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.390114 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.390431 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.390750 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.391065 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.391424 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.391762 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.392109 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.392454 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.392780 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.393110 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.393453 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.393927 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.394246 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.394578 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.394909 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.395238 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.395555 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.396621 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.397025 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.397378 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.397726 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.398055 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.398376 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.398698 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.399040 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.399378 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.399703 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.400039 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.400367 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.400713 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.401016 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.401382 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.401721 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.402140 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.402463 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.402785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.403168 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.403487 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.403837 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.404162 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.404497 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.404829 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.405145 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.405511 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.406012 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.406560 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.407100 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.407467 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.407810 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.408238 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.408720 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.409049 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:39:43.409394 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 16:39:43.514499 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO dbcounter [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Registered counter for database nova_api Jun 21 16:39:43.538221 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_db.sqlalchemy.engines [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:39:43.545510 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writer thread running {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:39:43.579003 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO dbcounter [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Registered counter for database nova_api Jun 21 16:39:43.601805 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG oslo_db.sqlalchemy.engines [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:39:43.606652 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.context [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd78fa9d-4a9e-4489-98e3-ab61d677bb6e(cell1) {{(pid=110303) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 16:39:43.608493 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writer thread running {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:39:43.610660 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:39:43.612372 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:39:43.613151 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:39:43.615776 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:39:43.617798 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO dbcounter [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Registered counter for database nova_cell0 Jun 21 16:39:43.621925 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO dbcounter [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Registered counter for database nova_cell1 Jun 21 16:39:43.629840 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_db.sqlalchemy.engines [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:39:43.632192 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_db.sqlalchemy.engines [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:39:43.638272 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writer thread running {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:39:43.640065 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writer thread running {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:39:43.668884 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.context [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd78fa9d-4a9e-4489-98e3-ab61d677bb6e(cell1) {{(pid=110304) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 16:39:43.672895 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:39:43.674511 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:39:43.675307 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:39:43.677876 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:39:43.679908 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO dbcounter [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Registered counter for database nova_cell0 Jun 21 16:39:43.684004 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO dbcounter [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Registered counter for database nova_cell1 Jun 21 16:39:43.691170 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG oslo_db.sqlalchemy.engines [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:39:43.693641 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG oslo_db.sqlalchemy.engines [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:39:43.699740 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writer thread running {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:39:43.701553 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writer thread running {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:39:43.789694 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO dbcounter [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Registered counter for database nova_cell0 Jun 21 16:39:43.798506 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_db.sqlalchemy.engines [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:39:43.804011 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writer thread running {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:39:43.856222 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO dbcounter [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Registered counter for database nova_cell0 Jun 21 16:39:43.862112 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG oslo_db.sqlalchemy.engines [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:39:43.867364 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writer thread running {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:39:44.221213 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: WARNING keystonemiddleware.auth_token [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 16:39:44.229497 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: WARNING keystonemiddleware.auth_token [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 16:39:44.258498 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: WARNING keystonemiddleware.auth_token [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 16:39:44.265948 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: WARNING keystonemiddleware.auth_token [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 16:39:44.571258 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: WARNING keystonemiddleware.auth_token [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 16:39:44.577159 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: WARNING keystonemiddleware.auth_token [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 16:39:44.582428 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5e73cb9c0 pid: 110303 (default app) Jun 21 16:39:44.585004 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:39:44.586221 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 Jun 21 16:39:44.586622 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Tue Jun 21 16:39:44 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:39:44.611571 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: WARNING keystonemiddleware.auth_token [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 16:39:44.617830 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: WARNING keystonemiddleware.auth_token [None req-f1428dd6-9a4b-46f2-a4a0-d2ae07e7a085 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 16:39:44.623109 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5e73cb9c0 pid: 110304 (default app) Jun 21 16:41:04.377978 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:04.386909 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Jun 21 16:41:04.386909 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:04.402468 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_api:SELECT=3 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:04.404129 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_cell1:SELECT=3 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:04.405172 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_cell0:SELECT=3 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:04.406219 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:04.872126 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-0dd60c8d-4588-496f-89d8-52c7430ba085 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:04.903441 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-0dd60c8d-4588-496f-89d8-52c7430ba085 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.516229 Jun 21 16:41:04.904263 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 1/3] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jun 21 16:41:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:41:07.028371 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:07.029314 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-c11297b9-7b44-4fd7-a36e-1fd38be34b4a None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 21 16:41:07.029729 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 3/4] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:07.092687 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-56bf0750-23b6-4128-ba6a-abb8c7b4d77a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:07.112731 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:41:07.112731 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: warnings.warn(msg) Jun 21 16:41:07.227926 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-56bf0750-23b6-4128-ba6a-abb8c7b4d77a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.191755 Jun 21 16:41:07.228733 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 2/5] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 16:41:07.243018 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_api:SELECT=3 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:07.244139 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_cell1:SELECT=3 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:07.245604 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_cell0:SELECT=3 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:07.246536 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:07.466069 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-f954386f-1c07-42c7-97eb-c9293cef21d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:07.470305 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:41:07.470305 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: warnings.warn(msg) Jun 21 16:41:07.722102 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-f954386f-1c07-42c7-97eb-c9293cef21d0 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.484181 Jun 21 16:41:07.730593 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 4/6] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 16:41:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:41:09.903159 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-56bf0750-23b6-4128-ba6a-abb8c7b4d77a admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:09.904355 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-56bf0750-23b6-4128-ba6a-abb8c7b4d77a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Jun 21 16:41:09.904926 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 3/7] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:10.021046 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-1ad8e56e-a23d-4085-a9dd-5bf29cf33661 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:10.039721 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:41:10.039721 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: warnings.warn(msg) Jun 21 16:41:10.162746 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-1ad8e56e-a23d-4085-a9dd-5bf29cf33661 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.250924 Jun 21 16:41:10.163291 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 5/8] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 16:41:10.176486 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-0889577e-eed3-48d0-923a-b97eeb807649 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:10.178469 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:41:10.178469 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: warnings.warn(msg) Jun 21 16:41:10.281257 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-0889577e-eed3-48d0-923a-b97eeb807649 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109263 Jun 21 16:41:10.281861 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 4/9] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 16:41:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:41:12.535568 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-1ad8e56e-a23d-4085-a9dd-5bf29cf33661 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:12.536881 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-1ad8e56e-a23d-4085-a9dd-5bf29cf33661 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Jun 21 16:41:12.537428 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:12.607246 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-36cbf516-5701-421b-9c32-35958022e399 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "name": "ds1G", "ram": 1024, "disk": 10}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:12.752528 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-36cbf516-5701-421b-9c32-35958022e399 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.207633 Jun 21 16:41:12.753383 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 5/11] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:41:12.765185 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-71cc3a15-d60d-47de-80ad-90a8d946c222 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:12.894318 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-71cc3a15-d60d-47de-80ad-90a8d946c222 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132579 Jun 21 16:41:12.895110 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 7/12] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 16:41:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:41:15.088834 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-36cbf516-5701-421b-9c32-35958022e399 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:15.089796 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-36cbf516-5701-421b-9c32-35958022e399 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jun 21 16:41:15.090453 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 6/13] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:15.158686 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-226e3044-a76e-498d-aa7b-b2b3ef82acb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "id": "d3", "swap": 0, "rxtx_factor": 1.0}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:15.266427 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-226e3044-a76e-498d-aa7b-b2b3ef82acb4 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.169163 Jun 21 16:41:15.267427 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 8/14] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:41:15.280784 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-caf1c0e1-9adb-4579-be5c-8ed2fc22d03c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:15.389684 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-caf1c0e1-9adb-4579-be5c-8ed2fc22d03c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113140 Jun 21 16:41:15.390195 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 7/15] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 16:41:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:41:17.521783 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-226e3044-a76e-498d-aa7b-b2b3ef82acb4 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:17.522714 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-226e3044-a76e-498d-aa7b-b2b3ef82acb4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Jun 21 16:41:17.523341 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 9/16] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:17.585140 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-ba6598d8-0b74-4542-acbf-0fc81dd8e411 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:17.661265 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-ba6598d8-0b74-4542-acbf-0fc81dd8e411 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132070 Jun 21 16:41:17.662239 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 8/17] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:41:17.674388 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-133bc428-7507-4ecb-b178-7b1e8eae05cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:17.760625 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-133bc428-7507-4ecb-b178-7b1e8eae05cd admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090368 Jun 21 16:41:17.761613 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 10/18] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jun 21 16:41:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:41:19.903702 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-ba6598d8-0b74-4542-acbf-0fc81dd8e411 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:19.904703 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-ba6598d8-0b74-4542-acbf-0fc81dd8e411 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 21 16:41:19.905112 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 9/19] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:19.967923 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-3616271d-5d70-42f1-9998-6d51b8509fa5 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:19.993094 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-3616271d-5d70-42f1-9998-6d51b8509fa5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081670 Jun 21 16:41:19.993681 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 11/20] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jun 21 16:41:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:41:22.346987 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-ba6598d8-0b74-4542-acbf-0fc81dd8e411 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:22.348698 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-ba6598d8-0b74-4542-acbf-0fc81dd8e411 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002242 Jun 21 16:41:22.349192 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 10/21] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:22.413678 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-ae5810b1-3dbb-4034-8c06-8df1d6bb1620 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:22.482873 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-ae5810b1-3dbb-4034-8c06-8df1d6bb1620 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.127732 Jun 21 16:41:22.483427 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 12/22] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:41:22.496394 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-6266303b-28f1-48c4-80ce-5284f8f4619e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:22.577375 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-6266303b-28f1-48c4-80ce-5284f8f4619e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084582 Jun 21 16:41:22.577981 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 11/23] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 16:41:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:41:24.718548 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-ae5810b1-3dbb-4034-8c06-8df1d6bb1620 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:24.721184 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-ae5810b1-3dbb-4034-8c06-8df1d6bb1620 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003169 Jun 21 16:41:24.721793 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:24.781581 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-4c894bbd-7a1a-469a-825a-344ce4288ff9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "disk": 20}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:24.836958 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-4c894bbd-7a1a-469a-825a-344ce4288ff9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.108836 Jun 21 16:41:24.837546 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 12/25] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:41:24.852509 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-ddf1360f-7810-4f1e-997c-87102ad5e209 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:24.926590 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-ddf1360f-7810-4f1e-997c-87102ad5e209 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079441 Jun 21 16:41:24.927174 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 14/26] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 16:41:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:41:27.027120 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-4c894bbd-7a1a-469a-825a-344ce4288ff9 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:27.028137 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-4c894bbd-7a1a-469a-825a-344ce4288ff9 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 21 16:41:27.028535 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 13/27] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:27.089926 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-c8869116-b058-4c51-b0ab-911e4a5ac19a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "vcpus": 2, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:27.179352 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-c8869116-b058-4c51-b0ab-911e4a5ac19a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.143724 Jun 21 16:41:27.179907 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 15/28] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:41:27.192552 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-100f32c4-fd53-49d0-8478-d072bdf409a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:27.303566 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-100f32c4-fd53-49d0-8478-d072bdf409a9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114661 Jun 21 16:41:27.304161 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 14/29] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 16:41:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:41:29.389156 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-c8869116-b058-4c51-b0ab-911e4a5ac19a admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:29.389156 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-c8869116-b058-4c51-b0ab-911e4a5ac19a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 21 16:41:29.389156 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 16/30] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:29.443191 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-6b584c15-08f1-4119-a47d-23b5d33a02ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "disk": 80}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:29.527218 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-6b584c15-08f1-4119-a47d-23b5d33a02ee admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135559 Jun 21 16:41:29.527777 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:41:29.540204 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-e5277cd5-5e79-4854-84ea-4f060ea6032e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:29.628630 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-e5277cd5-5e79-4854-84ea-4f060ea6032e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091977 Jun 21 16:41:29.629229 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 17/32] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 16:41:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:41:31.757073 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-6b584c15-08f1-4119-a47d-23b5d33a02ee admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:31.758109 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-6b584c15-08f1-4119-a47d-23b5d33a02ee admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 21 16:41:31.758502 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 16/33] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:31.826801 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-3171eaaf-5772-4c40-adc0-b13a135e2f8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:31.911146 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-3171eaaf-5772-4c40-adc0-b13a135e2f8e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.146503 Jun 21 16:41:31.911957 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 18/34] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jun 21 16:41:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:41:31.925300 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-53c1660a-7bfc-4e4b-a277-8d55c441ee6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:41:32.011502 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-53c1660a-7bfc-4e4b-a277-8d55c441ee6a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091065 Jun 21 16:41:32.012018 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 17/35] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jun 21 16:41:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:41:58.002006 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-3171eaaf-5772-4c40-adc0-b13a135e2f8e admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:58.003020 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-3171eaaf-5772-4c40-adc0-b13a135e2f8e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jun 21 16:41:58.003419 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:58.013876 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:58.062544 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-e2381ab4-7c75-4b9e-b869-0d689b6e37fb admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:58.079320 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-e2381ab4-7c75-4b9e-b869-0d689b6e37fb admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070025 Jun 21 16:41:58.080053 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jun 21 16:41:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:41:59.012277 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-3171eaaf-5772-4c40-adc0-b13a135e2f8e admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:59.013266 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-3171eaaf-5772-4c40-adc0-b13a135e2f8e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 21 16:41:59.013685 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:41:59.212864 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-13891342-a3d1-4a74-8dc9-f507616af678 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:59.218524 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.wsgi [None req-13891342-a3d1-4a74-8dc9-f507616af678 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-13891342-a3d1-4a74-8dc9-f507616af678 admin admin] Request method failure captured: Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Accept: application/json Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Accept-Encoding: gzip, deflate Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Connection: keep-alive Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Content-Length: 0 Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Host: 10.222.0.70 Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Openstack-Api-Version: compute 2.90 Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Openstack-System-Scope: None Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: User-Agent: python-novaclient Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Auth-Token: gAAAAABisfTWpLW28VgPkRbC8ZGCc8QdcLoISp6wI3GTOEEGfED54kbZMJPzV0jL5d6deXURGzIckxDocO7TOiz_mO27XJEwAFKnmzQDItn14jp7T9Hhxe06p1nKyOFNi5bT-8GTo55MLni9SwwpeiFuFNQkCR1uLGoUpyFScz0c41slCSPpV1E Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Domain-Id: None Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Domain-Name: None Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Identity-Status: Confirmed Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Is-Admin-Project: True Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Domain-Id: default Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Domain-Name: Default Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Name: admin Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Role: reader,admin,member Jun 21 16:41:59.222413 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Roles: reader,admin,member Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b5dc23437bc45dfae144cb9e387649c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Tenant: admin Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Tenant-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Tenant-Name: admin Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User: admin Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Domain-Id: default Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Domain-Name: Default Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Id: 8935c834d03f4a008037c7655781e212 Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Name: admin Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: method: > Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: exception: Flavor 42 could not be found. Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: action_args: {'id': '42'} Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:41:59.224483 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:41:59.225785 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.227252 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-13891342-a3d1-4a74-8dc9-f507616af678 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:41:59.228811 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-13891342-a3d1-4a74-8dc9-f507616af678 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064144 Jun 21 16:41:59.228811 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 19/39] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jun 21 16:41:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 16:41:59.233533 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-5b5fa034-1ad0-4fd5-b8e0-db3e7d84b6de admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:59.237425 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:41:59.257029 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-5b5fa034-1ad0-4fd5-b8e0-db3e7d84b6de admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027026 Jun 21 16:41:59.257617 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 21/40] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 16:41:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:41:59.267583 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-0edd2b98-1a09-4913-89e6-d859eb5cf64a admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:59.291317 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-0edd2b98-1a09-4913-89e6-d859eb5cf64a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027406 Jun 21 16:41:59.291870 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 20/41] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 16:41:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:41:59.302359 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-d3268042-cfc7-4a0e-99ed-79ec857551f2 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:41:59.308679 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.wsgi [None req-d3268042-cfc7-4a0e-99ed-79ec857551f2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-d3268042-cfc7-4a0e-99ed-79ec857551f2 admin admin] Request method failure captured: Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Accept: application/json Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Accept-Encoding: gzip, deflate Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Connection: keep-alive Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Content-Length: 0 Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Host: 10.222.0.70 Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Openstack-Api-Version: compute 2.90 Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Openstack-System-Scope: None Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: User-Agent: python-novaclient Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Auth-Token: gAAAAABisfTWpLW28VgPkRbC8ZGCc8QdcLoISp6wI3GTOEEGfED54kbZMJPzV0jL5d6deXURGzIckxDocO7TOiz_mO27XJEwAFKnmzQDItn14jp7T9Hhxe06p1nKyOFNi5bT-8GTo55MLni9SwwpeiFuFNQkCR1uLGoUpyFScz0c41slCSPpV1E Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Domain-Id: None Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Domain-Name: None Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Identity-Status: Confirmed Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Is-Admin-Project: True Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Domain-Id: default Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Domain-Name: Default Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Name: admin Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Role: reader,admin,member Jun 21 16:41:59.324274 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Roles: reader,admin,member Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b5dc23437bc45dfae144cb9e387649c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Tenant: admin Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Tenant-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Tenant-Name: admin Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User: admin Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Domain-Id: default Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Domain-Name: Default Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Id: 8935c834d03f4a008037c7655781e212 Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Name: admin Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: method: > Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: exception: Flavor 42 could not be found. Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: action_args: {'id': '42'} Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:41:59.325966 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:41:59.327015 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:41:59.328376 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-d3268042-cfc7-4a0e-99ed-79ec857551f2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:41:59.329837 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-d3268042-cfc7-4a0e-99ed-79ec857551f2 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015638 Jun 21 16:41:59.329837 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 22/42] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jun 21 16:41:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:00.136212 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-0edd2b98-1a09-4913-89e6-d859eb5cf64a admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:00.137242 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-0edd2b98-1a09-4913-89e6-d859eb5cf64a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jun 21 16:42:00.137668 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:42:00.332236 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-4076333d-c8db-415f-9b6c-674e4800bb80 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:00.337702 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.wsgi [None req-4076333d-c8db-415f-9b6c-674e4800bb80 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-4076333d-c8db-415f-9b6c-674e4800bb80 admin admin] Request method failure captured: Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Accept: application/json Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Accept-Encoding: gzip, deflate Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Connection: keep-alive Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Content-Length: 0 Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Host: 10.222.0.70 Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Openstack-Api-Version: compute 2.90 Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Openstack-System-Scope: None Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: User-Agent: python-novaclient Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Auth-Token: gAAAAABisfTY2p16fW8kHd9pGavjJL01FOIDlVoeixSfpZ2kq6eEGd_rgzHTiVnaDpi6FDADLQV3DZ3Vzc7hIhkrfbIm2TPqVBAEbIoUCiXMnfR5gSkrxqYHQjI9MdSW1nbkeJdCoXyrtY5WuzuxqOJON4GGoPMHFSJfdKqbw4jjjXC4ZIIFtWI Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Domain-Id: None Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Domain-Name: None Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Identity-Status: Confirmed Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Is-Admin-Project: True Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Domain-Id: default Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Domain-Name: Default Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Name: admin Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Role: reader,admin,member Jun 21 16:42:00.339240 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Roles: reader,admin,member Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b5dc23437bc45dfae144cb9e387649c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Tenant: admin Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Tenant-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Tenant-Name: admin Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User: admin Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Domain-Id: default Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Domain-Name: Default Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Id: 8935c834d03f4a008037c7655781e212 Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Name: admin Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: method: > Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: exception: Flavor 84 could not be found. Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: action_args: {'id': '84'} Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:42:00.340792 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:42:00.342983 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.344356 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-4076333d-c8db-415f-9b6c-674e4800bb80 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:42:00.346600 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-4076333d-c8db-415f-9b6c-674e4800bb80 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063851 Jun 21 16:42:00.346600 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jun 21 16:42:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:00.351643 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-a18e657c-be70-4132-a318-a87dac0727c5 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:00.366461 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-a18e657c-be70-4132-a318-a87dac0727c5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018871 Jun 21 16:42:00.367028 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 16:42:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:42:00.376819 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-381aa012-7f80-4141-bc3d-f48d42e03906 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:00.393179 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-381aa012-7f80-4141-bc3d-f48d42e03906 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019260 Jun 21 16:42:00.393750 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 16:42:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:42:00.402935 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-10cfcf62-88d2-4f87-a95e-24431ee651ec admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:00.409104 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.wsgi [None req-10cfcf62-88d2-4f87-a95e-24431ee651ec admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-10cfcf62-88d2-4f87-a95e-24431ee651ec admin admin] Request method failure captured: Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Accept: application/json Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Accept-Encoding: gzip, deflate Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Connection: keep-alive Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Content-Length: 0 Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Host: 10.222.0.70 Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Openstack-Api-Version: compute 2.90 Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Openstack-System-Scope: None Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: User-Agent: python-novaclient Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Auth-Token: gAAAAABisfTY2p16fW8kHd9pGavjJL01FOIDlVoeixSfpZ2kq6eEGd_rgzHTiVnaDpi6FDADLQV3DZ3Vzc7hIhkrfbIm2TPqVBAEbIoUCiXMnfR5gSkrxqYHQjI9MdSW1nbkeJdCoXyrtY5WuzuxqOJON4GGoPMHFSJfdKqbw4jjjXC4ZIIFtWI Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Domain-Id: None Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Domain-Name: None Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Identity-Status: Confirmed Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Is-Admin-Project: True Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Domain-Id: default Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Domain-Name: Default Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Name: admin Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Role: reader,admin,member Jun 21 16:42:00.411390 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Roles: reader,admin,member Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b5dc23437bc45dfae144cb9e387649c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Tenant: admin Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Tenant-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Tenant-Name: admin Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User: admin Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Domain-Id: default Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Domain-Name: Default Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Id: 8935c834d03f4a008037c7655781e212 Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Name: admin Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: method: > Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: exception: Flavor 84 could not be found. Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: action_args: {'id': '84'} Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:42:00.413048 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:42:00.414130 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:00.415478 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-10cfcf62-88d2-4f87-a95e-24431ee651ec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:42:00.416757 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-10cfcf62-88d2-4f87-a95e-24431ee651ec admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012843 Jun 21 16:42:00.416757 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 23/47] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jun 21 16:42:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:01.230075 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-381aa012-7f80-4141-bc3d-f48d42e03906 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:01.231071 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-381aa012-7f80-4141-bc3d-f48d42e03906 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 21 16:42:01.231469 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 25/48] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:42:01.421132 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-cb3bc8bc-080e-4cbb-9ff4-e94124ac0d18 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:01.427005 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.wsgi [None req-cb3bc8bc-080e-4cbb-9ff4-e94124ac0d18 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-cb3bc8bc-080e-4cbb-9ff4-e94124ac0d18 admin admin] Request method failure captured: Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Accept: application/json Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Accept-Encoding: gzip, deflate Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Connection: keep-alive Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Content-Length: 0 Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Host: 10.222.0.70 Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Openstack-Api-Version: compute 2.90 Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Openstack-System-Scope: None Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: User-Agent: python-novaclient Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Auth-Token: gAAAAABisfTZ7lcYLMPZkKJL45eRWwmVnYQCNjQeFViQ77iM7aKqVKtrfzV66e3F9UOtCwuMAvExDpBl2RXG5ihTbsaHMELHnoYE48t_Aico2uGbLiFemXY6AbJg-oqi7rJUFneJSCidhkjdpXUrhaXaVdfpSWp3Yn5KYAYqEJKaHAFrGtkLkX4 Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Domain-Id: None Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Domain-Name: None Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Identity-Status: Confirmed Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Is-Admin-Project: True Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Domain-Id: default Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Domain-Name: Default Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Project-Name: admin Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Role: reader,admin,member Jun 21 16:42:01.428501 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Roles: reader,admin,member Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b5dc23437bc45dfae144cb9e387649c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Tenant: admin Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Tenant-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-Tenant-Name: admin Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User: admin Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Domain-Id: default Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Domain-Name: Default Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Id: 8935c834d03f4a008037c7655781e212 Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: X-User-Name: admin Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: method: > Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: exception: Flavor 451 could not be found. Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: action_args: {'id': '451'} Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:42:01.435952 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:42:01.436868 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.438227 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-cb3bc8bc-080e-4cbb-9ff4-e94124ac0d18 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:42:01.440231 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-cb3bc8bc-080e-4cbb-9ff4-e94124ac0d18 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060594 Jun 21 16:42:01.440231 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 24/49] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 16:42:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:01.440411 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-70ac4192-bb64-44eb-bcbc-8b50725b3be7 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:01.454029 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-70ac4192-bb64-44eb-bcbc-8b50725b3be7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017959 Jun 21 16:42:01.454552 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 26/50] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 16:42:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:42:01.464522 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:01.478123 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017610 Jun 21 16:42:01.478653 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jun 21 16:42:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:42:01.488296 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-b13812d9-62c5-4407-9f70-4317088cb942 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:01.493673 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.wsgi [None req-b13812d9-62c5-4407-9f70-4317088cb942 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-b13812d9-62c5-4407-9f70-4317088cb942 admin admin] Request method failure captured: Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Accept: application/json Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Accept-Encoding: gzip, deflate Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Connection: keep-alive Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Content-Length: 0 Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Host: 10.222.0.70 Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Openstack-Api-Version: compute 2.90 Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Openstack-System-Scope: None Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: User-Agent: python-novaclient Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Auth-Token: gAAAAABisfTZ7lcYLMPZkKJL45eRWwmVnYQCNjQeFViQ77iM7aKqVKtrfzV66e3F9UOtCwuMAvExDpBl2RXG5ihTbsaHMELHnoYE48t_Aico2uGbLiFemXY6AbJg-oqi7rJUFneJSCidhkjdpXUrhaXaVdfpSWp3Yn5KYAYqEJKaHAFrGtkLkX4 Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Domain-Id: None Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Domain-Name: None Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Identity-Status: Confirmed Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Is-Admin-Project: True Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Domain-Id: default Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Domain-Name: Default Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Project-Name: admin Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Role: reader,admin,member Jun 21 16:42:01.495172 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Roles: reader,admin,member Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b5dc23437bc45dfae144cb9e387649c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b5dc23437bc45dfae144cb9e387649c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Tenant: admin Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Tenant-Id: 5b5dc23437bc45dfae144cb9e387649c Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-Tenant-Name: admin Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User: admin Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Domain-Id: default Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Domain-Name: Default Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Id: 8935c834d03f4a008037c7655781e212 Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: X-User-Name: admin Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: method: > Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: exception: Flavor 451 could not be found. Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: action_args: {'id': '451'} Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:42:01.496683 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:42:01.497633 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 21 16:42:01.500549 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-b13812d9-62c5-4407-9f70-4317088cb942 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:42:01.502490 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-b13812d9-62c5-4407-9f70-4317088cb942 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012241 Jun 21 16:42:01.502490 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 27/52] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 16:42:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 16:42:02.338940 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:02.339945 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 21 16:42:02.340343 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:42:02.529952 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-783d3810-d8d5-4a7a-b59c-a06be9e071a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:42:02.628464 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-783d3810-d8d5-4a7a-b59c-a06be9e071a5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.150439 Jun 21 16:42:02.629020 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 28/54] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jun 21 16:42:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:42:03.455285 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:03.456288 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001949 Jun 21 16:42:03.456690 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:42:03.648069 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-ba900254-9553-4246-a0f2-ac09dc62be48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:42:03.747307 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-ba900254-9553-4246-a0f2-ac09dc62be48 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.152698 Jun 21 16:42:03.747854 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 29/56] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jun 21 16:42:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:42:04.598526 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:04.599531 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 21 16:42:04.599964 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:42:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:42:04.790372 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-8b3cecb9-85ed-4d36-8cb0-3cb031937fae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:42:04.878738 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-8b3cecb9-85ed-4d36-8cb0-3cb031937fae admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.140837 Jun 21 16:42:04.879284 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jun 21 16:42:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:42:05.716998 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:05.718032 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 21 16:42:05.718433 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 29/59] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:42:05.910585 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-5ba006cb-ed67-4c85-a3c8-c5b32726bd41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:42:06.016749 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-5ba006cb-ed67-4c85-a3c8-c5b32726bd41 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.159133 Jun 21 16:42:06.017361 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 31/60] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jun 21 16:42:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:42:06.858725 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:06.859735 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 21 16:42:06.860139 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 30/61] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:42:07.049930 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-a80b5871-dd77-4297-873c-ca4f94c34d16 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:07.069335 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-a80b5871-dd77-4297-873c-ca4f94c34d16 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072206 Jun 21 16:42:07.069900 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 32/62] 10.222.0.70 () {60 vars in 1202 bytes} [Tue Jun 21 16:42:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:42:54.760595 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:54.761646 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-9e0e1720-4c20-4439-9d89-14ed628bc578 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 21 16:42:54.762047 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jun 21 16:42:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:42:54.773739 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:42:54.828198 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-8dfbc4f2-a15d-4c19-98ab-27240dd0075e admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:54.848642 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-8dfbc4f2-a15d-4c19-98ab-27240dd0075e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079497 Jun 21 16:42:54.849174 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 33/64] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jun 21 16:42:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:42:54.872681 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-aa00e9e5-e6d4-4815-95a2-e2c4c4783305 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:54.876580 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_api:SELECT=14 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:42:54.881595 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-aa00e9e5-e6d4-4815-95a2-e2c4c4783305 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012579 Jun 21 16:42:54.882110 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 32/65] 10.222.0.70 () {60 vars in 1282 bytes} [Tue Jun 21 16:42:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:42:54.894419 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-3058ae8e-d206-4fba-a88f-6faa4608345d admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:54.902358 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-3058ae8e-d206-4fba-a88f-6faa4608345d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011709 Jun 21 16:42:54.902870 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 34/66] 10.222.0.70 () {60 vars in 1285 bytes} [Tue Jun 21 16:42:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:42:54.915996 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:54.924812 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012861 Jun 21 16:42:54.925367 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1285 bytes} [Tue Jun 21 16:42:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:42:54.937168 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-0a64a74d-b706-4b16-9af3-7276b90f4d22 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:42:54.944992 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-0a64a74d-b706-4b16-9af3-7276b90f4d22 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011838 Jun 21 16:42:54.945560 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 35/68] 10.222.0.70 () {60 vars in 1282 bytes} [Tue Jun 21 16:42:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:46:23.487521 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:46:23.488561 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 21 16:46:23.488961 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 34/69] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:46:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:46:23.630822 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_api:SELECT=6 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:46:23.747519 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-33046430-b43d-4600-a9c8-3dfc18c295a6 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:46:23.748751 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:46:23.748751 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: warnings.warn(msg) Jun 21 16:46:23.750070 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-33046430-b43d-4600-a9c8-3dfc18c295a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:46:23.750512 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-33046430-b43d-4600-a9c8-3dfc18c295a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:46:23.751294 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-33046430-b43d-4600-a9c8-3dfc18c295a6 admin admin] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:46:23.751727 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-33046430-b43d-4600-a9c8-3dfc18c295a6 admin admin] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:46:23.786504 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-33046430-b43d-4600-a9c8-3dfc18c295a6 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.157132 Jun 21 16:46:23.787069 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 36/70] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 16:46:23 2022] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:46:24.629002 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:46:24.630035 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 21 16:46:24.630438 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 35/71] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:46:24.825300 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-1d730f93-7708-49cc-9cab-a4d5203246df admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:46:24.827249 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:46:24.827249 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: warnings.warn(msg) Jun 21 16:46:24.828432 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-1d730f93-7708-49cc-9cab-a4d5203246df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:46:24.828877 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-1d730f93-7708-49cc-9cab-a4d5203246df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:46:24.829689 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-1d730f93-7708-49cc-9cab-a4d5203246df admin admin] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:46:24.830171 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-1d730f93-7708-49cc-9cab-a4d5203246df admin admin] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:46:24.850790 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-1d730f93-7708-49cc-9cab-a4d5203246df admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078863 Jun 21 16:46:24.851377 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 37/72] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 16:46:24 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:46:36.089069 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:46:36.090108 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 21 16:46:36.091624 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 36/73] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:46:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:46:36.236004 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_cell0:SELECT=4 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:46:36.236739 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_cell1:SELECT=4 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:46:36.237385 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_api:SELECT=8 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:46:36.289203 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-56a0f676-a4ee-45f4-bbe6-d08dfc29757c admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:46:36.290426 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:46:36.290426 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: warnings.warn(msg) Jun 21 16:46:36.291574 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-56a0f676-a4ee-45f4-bbe6-d08dfc29757c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:46:36.292055 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-56a0f676-a4ee-45f4-bbe6-d08dfc29757c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:46:36.292887 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-56a0f676-a4ee-45f4-bbe6-d08dfc29757c admin admin] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:46:36.293435 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-56a0f676-a4ee-45f4-bbe6-d08dfc29757c admin admin] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:46:36.319631 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-56a0f676-a4ee-45f4-bbe6-d08dfc29757c admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.088527 Jun 21 16:46:36.320125 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 38/74] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 16:46:36 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:46:37.144953 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:46:37.145979 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-386efec3-735d-4965-ae6a-7f570857b661 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 21 16:46:37.146376 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 37/75] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jun 21 16:46:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:46:37.344994 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-0fa5246b-696f-4206-a3b5-484bc7cb285a admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:46:37.346266 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 16:46:37.346266 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: warnings.warn(msg) Jun 21 16:46:37.347543 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-0fa5246b-696f-4206-a3b5-484bc7cb285a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:46:37.348009 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-0fa5246b-696f-4206-a3b5-484bc7cb285a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:46:37.348832 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-0fa5246b-696f-4206-a3b5-484bc7cb285a admin admin] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:46:37.349262 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-0fa5246b-696f-4206-a3b5-484bc7cb285a admin admin] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:46:37.372444 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-0fa5246b-696f-4206-a3b5-484bc7cb285a admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080862 Jun 21 16:46:37.373010 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 39/76] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jun 21 16:46:37 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:47:35.847828 dv-cinder-799871-21-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 16:47:35.849078 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: Tue Jun 21 16:47:35 2022 - graceful shutdown triggered... Jun 21 16:47:35.849773 dv-cinder-799871-21-iscsi devstack@n-api.service[110303]: Gracefully killing worker 1 (pid: 110303)... Jun 21 16:47:35.850294 dv-cinder-799871-21-iscsi devstack@n-api.service[110304]: Gracefully killing worker 2 (pid: 110304)... Jun 21 16:47:36.849406 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: worker 1 buried after 1 seconds Jun 21 16:47:36.849967 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: worker 2 buried after 1 seconds Jun 21 16:47:36.849967 dv-cinder-799871-21-iscsi devstack@n-api.service[110302]: goodbye to uWSGI. Jun 21 16:47:36.851100 dv-cinder-799871-21-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 16:47:36.851760 dv-cinder-799871-21-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 16:47:36.854878 dv-cinder-799871-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 16:47:36.865051 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 16:47:36 2022] *** Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: nodename: dv-cinder-799871-21-iscsi Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: machine: x86_64 Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: clock source: unix Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: pcre jit disabled Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: detected number of CPU cores: 4 Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: current working directory: / Jun 21 16:47:36.867001 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: detected binary path: /usr/bin/uwsgi-core Jun 21 16:47:36.867667 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: your processes number limit is 47680 Jun 21 16:47:36.867667 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: your memory page size is 4096 bytes Jun 21 16:47:36.867667 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: detected max file descriptor number: 2048 Jun 21 16:47:36.867667 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: lock engine: pthread robust mutexes Jun 21 16:47:36.867667 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: thunder lock: enabled Jun 21 16:47:36.867667 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 16:47:36.867667 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 16:47:36.913402 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: Python main interpreter initialized at 0x55fbf08309c0 Jun 21 16:47:36.913402 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: python threads support enabled Jun 21 16:47:36.913402 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: your server socket listen backlog is limited to 100 connections Jun 21 16:47:36.913402 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: your mercy for graceful operations on workers is 90 seconds Jun 21 16:47:36.913846 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 16:47:36.913846 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: *** Operational MODE: preforking *** Jun 21 16:47:36.914129 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: *** uWSGI is running in multiple interpreter mode *** Jun 21 16:47:36.914129 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: spawned uWSGI master process (pid: 124669) Jun 21 16:47:36.914396 dv-cinder-799871-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 16:47:36.914933 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: spawned uWSGI worker 1 (pid: 124685, cores: 1) Jun 21 16:47:36.915263 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: spawned uWSGI worker 2 (pid: 124686, cores: 1) Jun 21 16:47:36.917317 dv-cinder-799871-21-iscsi devstack@n-api.service[124669]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 16:47:37.601571 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 16:47:37.616677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 16:47:38.826260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:47:38.826260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: from cryptography.utils import int_from_bytes Jun 21 16:47:38.827500 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:47:38.827500 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: from cryptography.utils import int_from_bytes Jun 21 16:47:38.866888 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:47:38.866888 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: from cryptography.utils import int_from_bytes Jun 21 16:47:38.867895 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 16:47:38.867895 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: from cryptography.utils import int_from_bytes Jun 21 16:47:41.296372 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 16:47:41.296974 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 16:47:41.297716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 16:47:41.298096 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 16:47:41.298362 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 16:47:41.298763 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.299098 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.299428 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.299753 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.300246 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.300728 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.301377 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.301867 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.302310 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.302582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.302906 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.303305 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-21-iscsi {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.303643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.304006 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.304363 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.304661 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.305018 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.305371 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.305688 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.306263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.306722 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.307060 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.307377 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.307819 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.308049 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.308377 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.308730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.309096 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.309411 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.309838 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.310144 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-21-iscsi {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.310469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.310786 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.311539 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.312025 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.312353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.312693 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.313184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.317848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.318386 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.318471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.318795 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.319130 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.319383 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.319671 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.320031 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.320356 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.320673 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.320985 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.321387 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.321634 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.321945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.322253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.322562 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.322872 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.323200 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.323521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.323891 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.324203 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.324528 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.324944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.325199 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.325582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.325933 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.326259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.327093 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.327486 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.327818 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.328978 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.329519 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.329999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.330336 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.330688 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.331007 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.331267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.331617 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.331931 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.332254 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.332735 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.333218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.333553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.334121 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.334433 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.334837 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.335053 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.335369 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.335688 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.336004 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.336317 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.336632 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.336946 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.337323 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.337898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.338297 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.338616 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.338930 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.339260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.339804 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.340122 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.340501 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.340843 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.341153 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.341509 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.341838 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.342784 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.343133 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.343469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.343773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.344086 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.344412 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.344781 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.345072 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.345441 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.351457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.351457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.351457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.351457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.351457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.351457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.351457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.351457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.352070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.352070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.352070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.352070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.352070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.352070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.352070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.352070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.352610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.352610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.352610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.352610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.352610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.352610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.353010 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.353230 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.353602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.353904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.354258 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.354600 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.354928 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.355254 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.355579 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.355898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.356220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.356553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.356887 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.357205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.358061 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.358384 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.358709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.359042 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.359377 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.359698 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.360040 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.360415 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.360746 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.361326 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.361656 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.361980 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.362577 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.362900 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.363708 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.363708 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.364032 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.364208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.364493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.364815 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.365136 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.365528 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.365845 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.366333 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.366658 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.366968 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.367287 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.367602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.367924 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.368237 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.368567 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.368909 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.369270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.369634 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.369955 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.370269 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.370587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.370905 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.371215 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.371569 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.371888 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.372204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.372534 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.372852 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.373162 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.373514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.373972 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.374464 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.374970 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.375297 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.375618 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.375938 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.376258 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.376594 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.376921 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.377239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.377605 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.377946 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.378263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.378632 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.379177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.379360 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.379582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.379899 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.380208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.380518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.380827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.381143 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.381646 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.381960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.382271 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.382613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.382994 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.383195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 16:47:41.383689 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.383909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 16:47:41.384081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.384081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.384360 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 16:47:41.384517 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.384663 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 16:47:41.385018 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.385173 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 16:47:41.385372 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.385526 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.385672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.385828 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.385828 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.386118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.386261 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.386413 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.386565 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.386725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.386871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.387015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.387167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.387323 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.387469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.387627 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.387627 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.387901 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.388052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.388204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.388349 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-21-iscsi {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.388504 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.388656 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.389416 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.389669 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.389859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.389859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.390147 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.390293 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.390498 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.390646 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.390791 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.390946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.391100 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.391246 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.391397 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.391543 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.391688 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.391978 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.392188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.392476 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.392632 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.392632 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.392919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.393079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.393226 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.393413 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.393560 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.393707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.393875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.394030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.394175 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.394327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.394480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.394643 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.394801 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.395256 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.395422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.395548 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.395663 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.395786 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-21-iscsi {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.395900 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.396012 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.396130 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.396253 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.396379 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.396493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.396614 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.396736 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.396852 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.396964 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.397076 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.397253 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.397918 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.398086 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.398254 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.398408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.398562 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.398709 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.398864 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.399019 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.399173 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.399173 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.399458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.399621 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.399775 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.399930 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.400095 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.400248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.400393 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.400551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.400697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.400697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.400971 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.401133 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.401334 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.401503 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.401659 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.401805 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.401950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.402114 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.402274 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.402436 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.402670 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.402830 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.402984 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.403131 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.403290 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.403558 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.403728 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.403876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.404023 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.404187 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.404350 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.404643 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.405500 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.405658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.405808 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.405967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.405967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.406263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.406263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.406546 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.406699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.406864 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.406864 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.407142 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.407293 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.407452 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.407607 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.407763 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.407917 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.408061 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.408213 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.408374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.408520 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.408673 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.408837 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.408990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.409144 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.409357 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.409531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.409678 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.409823 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.409975 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.410132 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.410279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.410505 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.410662 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.410817 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.410976 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.411129 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.411282 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.411438 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.411591 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.411737 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.411889 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.412036 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.412191 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.412381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.412541 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.412719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.412949 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.413121 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.413366 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.413532 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.413687 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.413841 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.413841 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.414117 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.414271 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.414425 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.414577 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.414765 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.415021 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.415206 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.415372 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.415700 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.415869 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.416030 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.416184 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.416343 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.416505 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.416664 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.416818 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.416979 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.417132 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.417318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.417489 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.417643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.417796 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.417796 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.417796 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.418255 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.418419 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.418580 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.418733 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.418887 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.419045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.419206 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.419406 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.419580 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.419734 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.419887 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.420039 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.420253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.420407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.420559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.420710 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.420881 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.421093 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.421259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.421452 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.421605 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.421769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.421921 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.422081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.422248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.422248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.422551 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.422711 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.422872 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.423119 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.423293 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.423453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.423607 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.423759 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.423933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.424095 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.424262 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.424424 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.424584 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.424744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.424897 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.425065 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.425230 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.425436 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.425609 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.425916 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.426095 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.426264 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.426426 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.426579 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.426731 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.426883 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.427043 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.427206 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.427366 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.427528 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.427681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.427833 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.427984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.428167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.428329 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.428482 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.428759 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.428925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.429094 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.429257 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.429451 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.429451 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.429767 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.429921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.430087 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.430241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.430408 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.430745 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.430910 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.431072 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 16:47:41.431240 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.431401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.431563 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.431715 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.431875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.432034 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.432196 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.432356 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.432522 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.432522 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.432809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.432974 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.433155 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.433431 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.433594 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.433755 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.433908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.433908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.434214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.434374 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.434535 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.434702 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.434855 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.435086 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.435256 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.435372 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.435486 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.435600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.435846 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.436292 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.436416 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.436529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.436643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.436774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.436899 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.437022 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.437136 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.437265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.437469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.443891 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.444089 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.444247 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.444409 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.444570 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.444724 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.444912 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.445131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.445360 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.445534 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.445534 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.445534 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.446075 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.446373 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.446542 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.446697 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.446859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.447019 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.447184 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.447338 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.447338 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.447648 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.447800 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.447959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.448127 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.448301 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.448527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.448694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.448849 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.449002 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.449164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.449403 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.449564 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.449731 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.449884 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.450050 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.450211 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.450380 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.450544 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.450705 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.450859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.451046 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.451202 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.451972 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.452197 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.452356 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.452556 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.452801 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.452958 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.453119 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.453273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.453454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.453713 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.453884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.454040 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.454192 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.454354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.454515 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.454677 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.454855 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.454855 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.455194 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.455366 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.455521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.455685 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.455839 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.456000 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.456153 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.456304 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.456561 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.456738 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.456931 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.457099 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.457262 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.457471 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.457625 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.457791 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.457960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.458113 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.458272 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.458433 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.458933 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.459107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.459269 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.459434 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.459595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.459750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.459911 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.460073 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.460226 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.460386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.460539 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.460691 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.460902 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.461063 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.461217 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.461413 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.461581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.461741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.461905 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.462065 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.462226 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.462378 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.462531 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.462691 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.462859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.463013 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.463164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.463316 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.463476 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.463476 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.463882 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.464052 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.464226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.464393 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.464554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.464727 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.464919 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.465079 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.465240 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.465433 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.465589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.465772 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.465926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.466079 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.466239 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.466416 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.466708 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.466871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.470280 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.470478 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.470657 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.470817 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.470997 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.471156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.471327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.471483 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.471636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.471798 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.471967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.472121 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.472273 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.472436 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.472597 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.472597 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.472912 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.473075 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.473229 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.473423 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.473591 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.473755 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.474017 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.474179 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.474333 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.474497 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.474651 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.474819 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.474981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.475136 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.475296 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.475458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.475633 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.475796 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.475796 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.476095 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.476249 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.476402 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.476402 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.476769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.476769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.477183 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.477183 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.477556 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.477734 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.477971 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.477971 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.478271 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.478434 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.478595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.478759 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.478920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.479082 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.479261 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.479554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.479731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.479903 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.480069 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.480230 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.480496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.480658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.480827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.480999 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.481162 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.481335 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.481495 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.481660 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.481815 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.481981 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.482142 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.482306 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.482460 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.482747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.482985 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.483145 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.483315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.483315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.483838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.484028 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.484288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.484457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.484619 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.484773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.484947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.485146 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.485478 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.485478 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.485792 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.485946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.486099 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.486260 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.486427 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.486581 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.486741 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.486900 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.487177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.487349 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.487510 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.487671 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.487825 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.487978 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.488131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.488293 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.488456 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.488617 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.488770 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.488924 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.489084 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.489259 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.489440 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.489600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.489764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.489764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.490056 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.490220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.490381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.490381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.490793 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.490961 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.491125 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.491280 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.491444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.491604 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.491758 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.491909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.492075 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.492229 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.492383 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.492536 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.492689 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.492850 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.493081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.493244 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.493455 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.493630 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.493785 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.493938 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.494104 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.494277 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.494507 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.494673 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.494828 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.494996 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.495284 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.495465 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.495622 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.495786 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.495939 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.496107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.496268 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.496421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.496576 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.496737 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.496941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.497113 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.497393 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.497555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.497720 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.497875 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.498123 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.498365 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.498524 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.498744 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.498924 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.499087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.499251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.499251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.499553 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.499706 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.499875 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.500041 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.500204 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.500375 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.500529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.500529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.500961 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.501116 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.501299 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.501462 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.501628 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.501783 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.501945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.502106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.502274 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.502436 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.502601 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.502762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.502917 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.503088 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.503251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.503404 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.503566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.503727 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.503882 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.504044 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.504205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.504358 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.504551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.504795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.504963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.505128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.505326 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.505498 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.505668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.505830 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.505985 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.506147 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.506336 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.506546 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.506805 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.506805 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.507246 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.507522 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.507683 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.507837 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.507993 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.508155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.508323 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.508478 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.508639 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.508793 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.508946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.508946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.509263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.509263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.509595 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.509759 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.509913 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.510067 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.510230 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.510391 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.510545 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.510704 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.510967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.511140 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.511304 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.511479 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.511641 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.511796 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.511949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.512111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.512265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.512425 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.512586 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.512747 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.512910 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.513072 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.513227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.513453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.513620 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.514355 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.514576 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.514778 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.515029 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.515190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.515360 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.515515 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.515668 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.515821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.515981 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.516274 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.516460 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.516616 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.516616 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.516616 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.517051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.517051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.517390 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.517648 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.517821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.517984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.518139 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.518302 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.518466 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.518642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.518803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.518965 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.519119 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.519281 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.519436 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.519589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.519751 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.519904 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.520056 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.520218 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.520372 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.520535 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.520535 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.520845 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.521086 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.521265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.521604 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.521764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.521918 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.522138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.522404 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.522669 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.522926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.523170 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.523440 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.523613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.523780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.523950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.524106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.524260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.524413 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.524566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.524795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.524953 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.525174 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.525354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.525561 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.525747 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.525904 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.526057 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.526217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.526471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.526639 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.526804 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.526959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.527121 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.527274 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.527429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.527618 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.527618 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.528016 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.528178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.528333 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.528486 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.528659 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.528827 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.528827 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.528827 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.528827 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.529645 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.530312 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.530312 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.530630 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.530783 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.530945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.531117 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.531368 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.531535 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.531690 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.531852 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.532021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.532183 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.532345 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.532506 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.532679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.532833 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.532833 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.533151 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.533336 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.533497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.533649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.533802 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.533802 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.533802 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.534250 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.534411 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.534585 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.534754 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.534907 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.535068 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.535227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.535388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.535542 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.535708 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.535870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.536031 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.536184 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.536338 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.536589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.536776 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.536941 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.537103 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.537257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.537448 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.537603 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.537765 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.538062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.538223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.538387 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.538387 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.538709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.538870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.539041 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.539203 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.539356 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.539508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.539508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.539815 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.539976 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.540137 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.540290 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.540442 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.540609 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.540769 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.540922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.541085 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.541237 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.541534 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.541693 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.541846 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.541999 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.542183 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.542389 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.542561 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.542726 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.542880 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.543032 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.543203 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.543203 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.543503 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.543503 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.543803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.543963 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.544124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.544124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.544430 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.544584 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.544736 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.544736 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.545027 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.545267 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.545450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.545604 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.545758 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.545912 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.546064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.546269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.546433 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.546613 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.546847 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.547007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.547167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.547330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.547495 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.547649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.547649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.547649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.548189 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.548432 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.548591 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.548744 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.548898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.548898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.549200 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.549390 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.549555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.549726 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.549887 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.550049 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.550211 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.550371 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.550532 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.550692 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.550853 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.550853 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.551177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.551338 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.551582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.551751 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.551925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.552080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.552287 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.552446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.552599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.552757 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.552937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.553102 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.553267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.553449 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.553613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.553767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.553940 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.554103 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.554258 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.554412 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.554564 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.554725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.554725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.555033 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.555196 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.555356 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.555508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.555661 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.555823 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.556006 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.556161 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.556315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.556468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.556620 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.556771 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.556771 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.556771 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.557387 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.557562 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.557717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.557879 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.558033 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.558214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.558461 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.558621 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.558773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.558940 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.559101 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.559254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.559422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.559575 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.559728 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.559891 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.560051 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.560223 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.560384 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.560558 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.561406 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.561623 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.561865 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.562027 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.562180 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.562341 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.562512 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.562668 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.562829 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.562981 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.563147 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.563309 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.563472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.563634 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.563795 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.563949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.564108 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.564261 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.564423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.564576 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.564730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.564890 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.565062 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.565230 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.565414 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.565414 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.565708 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.565708 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.566009 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.566171 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.566325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.566485 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.566638 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.566799 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.566960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.567237 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.567403 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.567565 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.567719 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.567873 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.567873 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.567873 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.568315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.568484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.568717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.568884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.569048 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.569214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.569394 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.569560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.569714 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.569876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.570045 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.570199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.570360 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.570514 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.570674 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.570836 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.570999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.571158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.571322 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.571483 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.571637 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.571800 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.572048 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.572216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.572370 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.572531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.572692 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.572860 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.573024 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.573177 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.573428 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.573589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.573743 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.573906 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.574061 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.574214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.574366 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.574519 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.574681 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.574841 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.574995 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.575157 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.575318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.575489 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.575651 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.575812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.575966 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.576126 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.576281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.577467 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.577643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.577798 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.577951 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.578112 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.578269 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.578421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.578421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.578754 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.578996 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.579164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.579319 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.579319 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.579767 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.579951 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.580117 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.580272 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.580685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.580937 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.581096 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.581271 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.581490 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.582414 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.582584 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.582796 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.582963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.583131 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.583286 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.583286 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.583286 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.584271 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.584450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.584621 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.584782 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.584936 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.585088 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.585249 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.585442 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.585609 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.585772 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.585926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.586124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.586286 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.586515 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.586704 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.586860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.587021 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.587176 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.587337 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.587622 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.587832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.587991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.588197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.588197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.588510 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.588680 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.588848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.589020 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.589304 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.589468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.589622 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.589794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.589956 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.590252 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.590416 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.590533 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.590654 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.590779 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.590895 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591010 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591010 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591010 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591010 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591467 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591988 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.591988 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.592221 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.592471 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.592600 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.592716 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.592841 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.593054 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.593180 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.593316 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.593316 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.598406 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.598569 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.598677 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.598767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.598862 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.598959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.599047 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.599143 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.599259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.599401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.599494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.599580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.599683 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.599823 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.599823 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600274 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600372 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600372 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600667 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600864 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.600864 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601055 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601144 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601356 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601543 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601632 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601632 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601632 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601877 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601965 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.601965 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602233 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602233 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602398 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602677 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602773 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602961 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.602961 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603323 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 16:47:41.603425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.603989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.604750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.604750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.604750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.604750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.604750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.604750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.604750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.604750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.605992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.606580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.606580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.606580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.606580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.606580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.606580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.606580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.606580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.607947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.608747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.608747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.608747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.608747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.608747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.608747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.608747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.608747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.609443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.609443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.609443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.609443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.609443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.609443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.609443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.609443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.610098 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.610098 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.610098 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.610098 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.610098 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.610480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.610608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.611114 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.611451 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.611774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.612109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.612446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.612756 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.613062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.613408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.613732 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.614045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.614357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.614668 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.614983 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.615290 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.615598 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.615908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.616218 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.616527 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.616836 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.617145 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.617480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.617789 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.618106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.618447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.618767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.619087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.619431 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.619749 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.620056 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.621184 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.621525 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.621833 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.622152 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.622485 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.622803 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.623109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.625602 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.625985 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.626482 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.626844 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.627191 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.627554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.627902 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.628264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.628610 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.628946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.629316 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.629683 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.630034 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.630498 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.630976 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.631397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.631755 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.632084 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.632420 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.632776 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.633101 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.633433 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.637866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.637866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.637866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.637866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.637866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.637866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.637866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.637866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.638589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.638589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.638589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.638589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.638589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.638589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.638589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.638589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.639770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.639770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.639913 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.640238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.640533 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.640866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.641218 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.641591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.641912 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.642244 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.642575 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.642902 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.643223 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.643565 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.643916 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.644272 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.644595 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.644911 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.645230 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.646203 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.646551 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.646891 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.647207 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.647543 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.647872 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.648201 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.648528 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.648849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.649217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.649696 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.650051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.650379 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.650694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.651013 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.651337 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.651662 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.651998 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.652331 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.652651 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.652984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.653443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.653806 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.654129 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.654511 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.654889 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.655309 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.655527 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.655836 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 16:47:41.656084 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 16:47:41.656980 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO dbcounter [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Registered counter for database nova_api Jun 21 16:47:41.677550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_db.sqlalchemy.engines [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:47:41.684121 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writer thread running {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:47:41.720666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO dbcounter [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Registered counter for database nova_api Jun 21 16:47:41.740983 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_db.sqlalchemy.engines [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:47:41.741643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.context [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd78fa9d-4a9e-4489-98e3-ab61d677bb6e(cell1) {{(pid=124685) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 16:47:41.745779 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:47:41.747392 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:47:41.747832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writer thread running {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:47:41.748713 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:47:41.751101 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:47:41.753140 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO dbcounter [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Registered counter for database nova_cell0 Jun 21 16:47:41.757384 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO dbcounter [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Registered counter for database nova_cell1 Jun 21 16:47:41.765611 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_db.sqlalchemy.engines [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:47:41.766572 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_db.sqlalchemy.engines [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:47:41.773866 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writer thread running {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:47:41.775176 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writer thread running {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:47:41.806398 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.context [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd78fa9d-4a9e-4489-98e3-ab61d677bb6e(cell1) {{(pid=124686) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 16:47:41.810570 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:47:41.812772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:47:41.813628 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:47:41.815602 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:47:41.817700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO dbcounter [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Registered counter for database nova_cell0 Jun 21 16:47:41.821802 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO dbcounter [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Registered counter for database nova_cell1 Jun 21 16:47:41.829442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_db.sqlalchemy.engines [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:47:41.831745 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_db.sqlalchemy.engines [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:47:41.836647 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writer thread running {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:47:41.926902 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO dbcounter [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Registered counter for database nova_cell0 Jun 21 16:47:41.934013 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_db.sqlalchemy.engines [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:47:41.939205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writer thread running {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:47:41.979814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writer thread running {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:47:41.991101 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO dbcounter [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Registered counter for database nova_cell0 Jun 21 16:47:41.998068 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_db.sqlalchemy.engines [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 16:47:42.003497 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writer thread running {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 16:47:42.267221 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: WARNING keystonemiddleware.auth_token [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 16:47:42.275840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: WARNING keystonemiddleware.auth_token [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 16:47:42.333538 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: WARNING keystonemiddleware.auth_token [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 16:47:42.341134 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: WARNING keystonemiddleware.auth_token [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 16:47:42.628787 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: WARNING keystonemiddleware.auth_token [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 16:47:42.634964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: WARNING keystonemiddleware.auth_token [None req-624a519c-78d3-4847-8a5b-1c8d77c1e241 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 16:47:42.640772 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fbf08309c0 pid: 124685 (default app) Jun 21 16:47:42.716424 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: WARNING keystonemiddleware.auth_token [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 16:47:42.723643 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: WARNING keystonemiddleware.auth_token [None req-dde9a0e7-d964-4811-8ce6-f21d59dd1b89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 16:47:42.729032 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fbf08309c0 pid: 124686 (default app) Jun 21 16:48:26.003834 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=3 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:26.005176 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=3 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:26.006034 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=3 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:26.007274 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=3 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:27.118439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5b0956f5-e5a8-4b45-9c0e-e1b18c43ec40 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] Action: 'create', calling method: .version_select at 0x7f0a48af2700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1681081070", "metadata": {"Type": "work"}}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:48:29.347679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5b0956f5-e5a8-4b45-9c0e-e1b18c43ec40 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.357741 Jun 21 16:48:29.348488 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jun 21 16:48:25 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3360 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 16:48:29.363438 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=3 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:29.364422 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=3 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:29.365314 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=3 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:29.372075 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=3 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:48:29.833386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e5e6a9c8-67dd-423b-8da2-bc7519f0d4df tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] Calling method '.version_select at 0x7f0a48b3f160>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:30.183947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e5e6a9c8-67dd-423b-8da2-bc7519f0d4df tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d" status: 200 len: 353 microversion: 2.1 time: 0.825735 Jun 21 16:48:30.185027 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 1/2] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:48:29 2022] GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d => generated 353 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:48:31.198672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-85dcd46f-4e6d-44c0-9dca-c081a9599f89 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] Calling method '.version_select at 0x7f0a489ba550>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:31.499033 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-85dcd46f-4e6d-44c0-9dca-c081a9599f89 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d" status: 200 len: 354 microversion: 2.1 time: 0.305452 Jun 21 16:48:31.499615 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:48:31 2022] GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d => generated 354 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:48:31.512482 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-230427d3-8245-48ee-88e9-69ad97d9bbc1 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] Calling method '.version_select at 0x7f0a48a06820>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:31.596150 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-230427d3-8245-48ee-88e9-69ad97d9bbc1 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d" status: 200 len: 354 microversion: 2.1 time: 0.088889 Jun 21 16:48:31.596983 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:48:31 2022] GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:48:31.615998 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f0c178cd-db3a-41a1-85cf-2bdce8d2c2fe tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] Calling method '.version_select at 0x7f0a489ba8b0>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:32.091208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f0c178cd-db3a-41a1-85cf-2bdce8d2c2fe tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d" status: 202 len: 0 microversion: 2.1 time: 0.480345 Jun 21 16:48:32.093627 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 3/5] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:48:31 2022] DELETE /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:48:32.107299 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2d059387-e83c-48e2-8124-8dbad6dddafa tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] Calling method '.version_select at 0x7f0a48a06310>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:32.306989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2d059387-e83c-48e2-8124-8dbad6dddafa tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d" status: 200 len: 353 microversion: 2.1 time: 0.205271 Jun 21 16:48:32.307773 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 3/6] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:48:32 2022] GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:48:33.320224 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6474a8cf-eae1-449c-95a6-5e6cd69afcf6 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] Calling method '.version_select at 0x7f0a489baca0>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:33.419293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-6474a8cf-eae1-449c-95a6-5e6cd69afcf6 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] HTTP exception thrown: Volume 083fd51c-b710-4eb9-bdcb-d9180d61c42d could not be found. Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6474a8cf-eae1-449c-95a6-5e6cd69afcf6 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] Request method failure captured: Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d HTTP/1.1 Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZZG-PIC5uojJQ39njIVw6wPkQhib-b34EouLRwncO0VAOCh1yz2OeB47i2IBZaIxi7Pey1xnRHBB4t9UI7rOJ2bDnVz44TDlsxjaISqckbYlQ2ZEEjUe40CcUl8QnQOY-KOfIoML4GeATbau2niYAsSV5WOab7jUtX5Elo6hHbwR8 Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: f908215832834011b2b303260dc55467 Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-VolumesGetTestJSON-1245504789 Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:48:33.425904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f908215832834011b2b303260dc55467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f908215832834011b2b303260dc55467"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f908215832834011b2b303260dc55467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f908215832834011b2b303260dc55467", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-VolumesGetTestJSON-1245504789 Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: f908215832834011b2b303260dc55467 Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-VolumesGetTestJSON-1245504789 Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-VolumesGetTestJSON-1245504789-project Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 0d8b144f25af475cbcefd18ecd69aa7e Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-VolumesGetTestJSON-1245504789-project Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Volume 083fd51c-b710-4eb9-bdcb-d9180d61c42d could not be found. Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '083fd51c-b710-4eb9-bdcb-d9180d61c42d'} Jun 21 16:48:33.427523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 083fd51c-b710-4eb9-bdcb-d9180d61c42d could not be found. (HTTP 404) (Request-ID: req-790f1cb4-4013-4bf0-a456-4a107f87c430) Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:48:33.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:48:33.429991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 083fd51c-b710-4eb9-bdcb-d9180d61c42d could not be found. Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 16:48:33.431294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 083fd51c-b710-4eb9-bdcb-d9180d61c42d could not be found. Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 083fd51c-b710-4eb9-bdcb-d9180d61c42d could not be found. Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6474a8cf-eae1-449c-95a6-5e6cd69afcf6 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] Returning 404 to user: Volume 083fd51c-b710-4eb9-bdcb-d9180d61c42d could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6474a8cf-eae1-449c-95a6-5e6cd69afcf6 tempest-VolumesGetTestJSON-1245504789 tempest-VolumesGetTestJSON-1245504789-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d" status: 404 len: 109 microversion: 2.1 time: 0.112108 Jun 21 16:48:33.433231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:48:33 2022] GET /compute/v2.1/os-volumes/083fd51c-b710-4eb9-bdcb-d9180d61c42d => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:48:40.957191 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-818b0715-d148-46bc-94c5-0ca21118a063 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'create', calling method: .version_select at 0x7f0a48a06e50>, body: {"keypair": {"name": "tempest-keypair-460699218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF66aSMnKMrbZXuIGUDcuZfsqSDgNfJZ6vlvWREt2FxgO2s49tOeR2rAKPL0hHXKK+cFXCumxloaviWxelrjKyW9DOQGuUIXo+vHS3wCGBRBRxhn+Fq4XeMMD2yl6NsQ9g=="}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:48:40.998590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1964073435", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:48:41.088269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-818b0715-d148-46bc-94c5-0ca21118a063 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Getting quotas for project 85cd0d0402244286b9199e77f8ef18ca. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:48:41.112194 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-818b0715-d148-46bc-94c5-0ca21118a063 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Getting quotas for user a25a52e592a34cd48a8c88304501c047 and project 85cd0d0402244286b9199e77f8ef18ca. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:48:41.215275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] validate_networks() for [('645d33ca-1458-475e-a591-c2b90b24a4f2', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:48:41.311014 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-818b0715-d148-46bc-94c5-0ca21118a063 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.901206 Jun 21 16:48:41.312381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 4/8] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jun 21 16:48:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 905 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 16:48:41.695929 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fb496b50-828a-4358-b7d7-bfb11574a4fc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'create', calling method: .version_select at 0x7f0a4891f280>, body: {"keypair": {"name": "tempest-keypair-1857301077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzHWjaWnv7qM8tfYU0eIcNCoV7QujXFr6TbmJkdntdnzD5/Nqs2AZSWLHk1yqGqwcQsmgnaAutSdXY9tbfKYSFOA20ozLZy1oqkSOmSkeg8P7yNiBFrE3/eHCPYWRszeQ=="}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:48:41.762500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-fb496b50-828a-4358-b7d7-bfb11574a4fc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Getting quotas for project 0a35c2bcb0e44e0ab3751a83635424e8. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:48:41.788008 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-fb496b50-828a-4358-b7d7-bfb11574a4fc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Getting quotas for user 52ad18360dc64d2ea85cc950c9daa723 and project 0a35c2bcb0e44e0ab3751a83635424e8. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:48:42.001667 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fb496b50-828a-4358-b7d7-bfb11574a4fc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.687085 Jun 21 16:48:42.005733 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 5/9] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 16:48:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:48:43.571468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-209333472", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "networks": [{"uuid": "b5de278b-fb20-455a-9731-6381c2870c95"}]}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:48:43.807397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.network.neutron [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] validate_networks() for [('b5de278b-fb20-455a-9731-6381c2870c95', None, None, None, None, None)] {{(pid=124686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:48:44.405543 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:48:44.409260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:48:44.409260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:48:44.409260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:48:44.409260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:48:44.469716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:44.469716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:44.469716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:44.469716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:44.536546 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Getting quotas for project 25beca9acf4f4420b1a2dc0ec397847e. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:48:44.550788 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Getting quotas for user f45384380b364e60823101515b359ba6 and project 25beca9acf4f4420b1a2dc0ec397847e. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:48:44.583985 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:48:44.586888 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:48:44.925782 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-09101de4-8e0b-4eb0-a9e9-fb7a0169a993 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.417757 Jun 21 16:48:44.926920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 5/10] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:48:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 4420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:48:44.955788 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d8fd6b4f-6bca-4748-a7c0-ef28832ed073 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:44.960108 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d8fd6b4f-6bca-4748-a7c0-ef28832ed073 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:45.190539 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d8fd6b4f-6bca-4748-a7c0-ef28832ed073 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:45.225933 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d8fd6b4f-6bca-4748-a7c0-ef28832ed073 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1222 microversion: 2.1 time: 0.284099 Jun 21 16:48:45.228645 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 6/11] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:44 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1222 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:48:45.635794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1317323611", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:48:45.767390 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] validate_networks() for [('645d33ca-1458-475e-a591-c2b90b24a4f2', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:48:46.771129 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Flavor limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:48:46.771624 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Image limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:48:46.772025 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Flavor pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:48:46.772560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Image pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:48:46.772980 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:48:46.822163 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:46.822653 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:46.823473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:46.824022 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:46.953164 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Getting quotas for project 8d951c7f7afd49b09b6045b09a9d98e0. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:48:46.954360 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Getting quotas for user 22950ef462df4f54a999200e183200c3 and project 8d951c7f7afd49b09b6045b09a9d98e0. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:48:46.971700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Going to run 1 instances... {{(pid=124686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:48:46.977015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:48:47.080819 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:48:47.082595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:48:47.083319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:48:47.084505 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:48:47.085181 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:48:47.109107 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:47.119171 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:47.119171 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:47.119171 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:47.179634 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Getting quotas for project 25beca9acf4f4420b1a2dc0ec397847e. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:48:47.187656 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Getting quotas for user f45384380b364e60823101515b359ba6 and project 25beca9acf4f4420b1a2dc0ec397847e. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:48:47.206163 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-125b145b-fad5-4a67-b6fa-61e7febcfcfd tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.162240 Jun 21 16:48:47.206163 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 6/12] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:48:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:48:47.226169 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a4bf0772-2e9c-4d59-8a03-9c905bd22690 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:47.228488 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a4bf0772-2e9c-4d59-8a03-9c905bd22690 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:47.235953 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:48:47.238601 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:48:47.474048 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-cac3c6ee-0e8d-4a24-b71e-c842e38d9ab8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.843345 Jun 21 16:48:47.475151 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 7/13] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:48:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 16:48:47.487594 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-17e1a1e8-36df-4708-9dd1-4a33b7ddbe0a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:47.488541 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-17e1a1e8-36df-4708-9dd1-4a33b7ddbe0a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:47.597374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-17e1a1e8-36df-4708-9dd1-4a33b7ddbe0a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:47.605102 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-17e1a1e8-36df-4708-9dd1-4a33b7ddbe0a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1222 microversion: 2.1 time: 0.122350 Jun 21 16:48:47.651027 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a4bf0772-2e9c-4d59-8a03-9c905bd22690 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:47.654888 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 8/14] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:47 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:47.685396 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a4bf0772-2e9c-4d59-8a03-9c905bd22690 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1214 microversion: 2.1 time: 0.467376 Jun 21 16:48:47.693746 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 7/15] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:47 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1214 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:48.655914 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-922e8e6f-5ffb-4274-9153-92cda521ed2e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:48.656890 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-922e8e6f-5ffb-4274-9153-92cda521ed2e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:48.706997 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2e571130-452e-4a14-9cf6-8f6987051e09 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:48.710952 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2e571130-452e-4a14-9cf6-8f6987051e09 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:48.802665 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-922e8e6f-5ffb-4274-9153-92cda521ed2e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:48.811724 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-922e8e6f-5ffb-4274-9153-92cda521ed2e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1222 microversion: 2.1 time: 0.160213 Jun 21 16:48:48.826208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 9/16] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:48 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:48.843120 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2e571130-452e-4a14-9cf6-8f6987051e09 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:48.859033 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2e571130-452e-4a14-9cf6-8f6987051e09 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1214 microversion: 2.1 time: 0.151989 Jun 21 16:48:48.860412 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 8/17] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:48 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:48:48.907218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1548600483", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8df8015f-3aaf-42f1-8475-cd22b8c0ed19"}], "security_groups": [{"name": "tempest-securitygroup--1821445832"}], "key_name": "tempest-keypair-460699218", "user_data": "}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:48:49.311859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] validate_networks() for [('8df8015f-3aaf-42f1-8475-cd22b8c0ed19', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:48:49.835007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-59f384c1-6de5-4cb0-a266-8f3765e0b3a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:49.836190 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-59f384c1-6de5-4cb0-a266-8f3765e0b3a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:49.846753 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-59f384c1-6de5-4cb0-a266-8f3765e0b3a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:49.848254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-59f384c1-6de5-4cb0-a266-8f3765e0b3a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:49.854338 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-59f384c1-6de5-4cb0-a266-8f3765e0b3a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:49.855006 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-59f384c1-6de5-4cb0-a266-8f3765e0b3a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:50.183191 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-59f384c1-6de5-4cb0-a266-8f3765e0b3a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:50.208494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-59f384c1-6de5-4cb0-a266-8f3765e0b3a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1226 microversion: 2.1 time: 0.380955 Jun 21 16:48:50.209941 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 9/18] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:49 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1226 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:48:50.217736 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1663686a-24b1-4836-b9dd-0f25bac95da0 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:50.219504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1663686a-24b1-4836-b9dd-0f25bac95da0 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:50.229570 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1663686a-24b1-4836-b9dd-0f25bac95da0 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:50.230571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1663686a-24b1-4836-b9dd-0f25bac95da0 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:50.232300 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1663686a-24b1-4836-b9dd-0f25bac95da0 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:50.233231 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1663686a-24b1-4836-b9dd-0f25bac95da0 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:50.384770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1663686a-24b1-4836-b9dd-0f25bac95da0 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:50.395209 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1663686a-24b1-4836-b9dd-0f25bac95da0 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1218 microversion: 2.1 time: 0.184037 Jun 21 16:48:50.396454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 10/19] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:50 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:50.415810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:48:50.421589 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:48:50.422328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:48:50.423679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:48:50.424671 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:48:50.443288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:50.446533 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:50.448830 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:50.449814 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:50.503637 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Getting quotas for project 85cd0d0402244286b9199e77f8ef18ca. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:48:50.514043 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Getting quotas for user a25a52e592a34cd48a8c88304501c047 and project 85cd0d0402244286b9199e77f8ef18ca. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:48:50.551565 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:48:50.554723 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:48:50.634167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2017368323", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63924b26-7bc3-4fc5-bf40-93746d4a252a"}], "security_groups": [{"name": "tempest-securitygroup--795050545"}], "key_name": "tempest-keypair-1857301077", "user_data": "}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:48:50.806960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5f3d8ae2-ca86-4c8f-9fe0-81677404a8a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.905149 Jun 21 16:48:50.817367 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 10/20] 10.222.0.70 () {62 vars in 1187 bytes} [Tue Jun 21 16:48:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 16:48:50.823411 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f996e60e-0a08-4e33-88cb-0192e2a9bf4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:50.824671 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f996e60e-0a08-4e33-88cb-0192e2a9bf4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:51.070201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f996e60e-0a08-4e33-88cb-0192e2a9bf4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:51.095155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f996e60e-0a08-4e33-88cb-0192e2a9bf4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:51.108864 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f996e60e-0a08-4e33-88cb-0192e2a9bf4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:51.110070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f996e60e-0a08-4e33-88cb-0192e2a9bf4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1281 microversion: 2.20 time: 0.292050 Jun 21 16:48:51.128213 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 11/21] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:48:50 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1281 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:48:51.230677 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ff1d76eb-6ece-4aea-9b20-c0d48ce0fa28 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:51.232219 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ff1d76eb-6ece-4aea-9b20-c0d48ce0fa28 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:51.259436 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ff1d76eb-6ece-4aea-9b20-c0d48ce0fa28 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:51.262298 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ff1d76eb-6ece-4aea-9b20-c0d48ce0fa28 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:51.266705 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ff1d76eb-6ece-4aea-9b20-c0d48ce0fa28 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:51.268858 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ff1d76eb-6ece-4aea-9b20-c0d48ce0fa28 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:51.636814 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ff1d76eb-6ece-4aea-9b20-c0d48ce0fa28 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:51.664090 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ff1d76eb-6ece-4aea-9b20-c0d48ce0fa28 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1226 microversion: 2.1 time: 0.438736 Jun 21 16:48:51.685754 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 12/22] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:51 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1226 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:51.696388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-daffa7b6-705b-4851-acb0-d3a2b59abb84 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:51.696388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-daffa7b6-705b-4851-acb0-d3a2b59abb84 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:51.703404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-daffa7b6-705b-4851-acb0-d3a2b59abb84 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:51.705093 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-daffa7b6-705b-4851-acb0-d3a2b59abb84 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:51.706335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-daffa7b6-705b-4851-acb0-d3a2b59abb84 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:51.707055 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-daffa7b6-705b-4851-acb0-d3a2b59abb84 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:51.824460 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-daffa7b6-705b-4851-acb0-d3a2b59abb84 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:51.843312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-daffa7b6-705b-4851-acb0-d3a2b59abb84 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1210 microversion: 2.1 time: 0.152469 Jun 21 16:48:51.844072 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 13/23] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:51 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1210 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:51.987797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.network.neutron [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] validate_networks() for [('63924b26-7bc3-4fc5-bf40-93746d4a252a', None, None, None, None, None)] {{(pid=124686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:48:52.146201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b12cb025-7091-425d-94e2-62e4697c0fd5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:52.146821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b12cb025-7091-425d-94e2-62e4697c0fd5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:52.247480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b12cb025-7091-425d-94e2-62e4697c0fd5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:52.260719 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b12cb025-7091-425d-94e2-62e4697c0fd5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:52.264181 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b12cb025-7091-425d-94e2-62e4697c0fd5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:52.266215 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b12cb025-7091-425d-94e2-62e4697c0fd5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1281 microversion: 2.20 time: 0.124597 Jun 21 16:48:52.267416 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 14/24] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:48:52 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1281 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:48:52.703530 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3dedb126-7674-4e8f-8698-4f19de3362e4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:52.704176 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3dedb126-7674-4e8f-8698-4f19de3362e4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:52.727258 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3dedb126-7674-4e8f-8698-4f19de3362e4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:52.742861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3dedb126-7674-4e8f-8698-4f19de3362e4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:52.749596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3dedb126-7674-4e8f-8698-4f19de3362e4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:52.753496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3dedb126-7674-4e8f-8698-4f19de3362e4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:53.069217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Flavor limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:48:53.070228 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Image limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:48:53.070865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Flavor pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:48:53.072288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Image pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:48:53.072863 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:48:53.087841 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:53.094575 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:53.095502 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:53.095950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:53.147928 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Getting quotas for project 0a35c2bcb0e44e0ab3751a83635424e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:48:53.152569 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Getting quotas for user 52ad18360dc64d2ea85cc950c9daa723 and project 0a35c2bcb0e44e0ab3751a83635424e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:48:53.177762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Going to run 1 instances... {{(pid=124686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:48:53.187779 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:48:53.412462 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-790d93bd-200a-4622-ac11-92a15e867510 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.785187 Jun 21 16:48:53.413137 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 11/25] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:48:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 16:48:53.418732 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3dedb126-7674-4e8f-8698-4f19de3362e4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:53.434934 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9889f7da-7670-47fb-9fd0-104ee4e5e06f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:53.435782 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9889f7da-7670-47fb-9fd0-104ee4e5e06f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:53.453125 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9889f7da-7670-47fb-9fd0-104ee4e5e06f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:53.453678 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9889f7da-7670-47fb-9fd0-104ee4e5e06f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:53.454103 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3dedb126-7674-4e8f-8698-4f19de3362e4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1274 microversion: 2.1 time: 0.771192 Jun 21 16:48:53.454910 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9889f7da-7670-47fb-9fd0-104ee4e5e06f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:53.455557 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9889f7da-7670-47fb-9fd0-104ee4e5e06f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:53.457466 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 15/26] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:52 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1274 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:53.474074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:53.475878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:53.500534 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:53.502598 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:53.507913 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:53.509578 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:53.866642 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:53.911891 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:53.927283 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:53.932788 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f9ed325b-10d5-4376-a969-b610e7ac9d5e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1285 microversion: 2.20 time: 0.472675 Jun 21 16:48:53.937917 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 16/27] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:48:53 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1285 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:48:53.953617 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-357c869d-a494-4c57-a651-6d398fa1bb30 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:53.956816 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-357c869d-a494-4c57-a651-6d398fa1bb30 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:54.196859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9889f7da-7670-47fb-9fd0-104ee4e5e06f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:54.208500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9889f7da-7670-47fb-9fd0-104ee4e5e06f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1274 microversion: 2.1 time: 0.793939 Jun 21 16:48:54.209098 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 12/28] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:53 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1274 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:54.472279 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6120125d-55b4-44bf-86c5-0daecde926c7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:54.473198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6120125d-55b4-44bf-86c5-0daecde926c7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:54.487735 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6120125d-55b4-44bf-86c5-0daecde926c7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:54.488198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6120125d-55b4-44bf-86c5-0daecde926c7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:54.488988 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6120125d-55b4-44bf-86c5-0daecde926c7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:54.502202 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6120125d-55b4-44bf-86c5-0daecde926c7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:54.671599 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6120125d-55b4-44bf-86c5-0daecde926c7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:54.681470 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6120125d-55b4-44bf-86c5-0daecde926c7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1280 microversion: 2.1 time: 0.213236 Jun 21 16:48:54.682077 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 13/29] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:54 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:48:54.726767 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-357c869d-a494-4c57-a651-6d398fa1bb30 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:54.736648 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-357c869d-a494-4c57-a651-6d398fa1bb30 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1238 microversion: 2.1 time: 0.796374 Jun 21 16:48:54.737710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 17/30] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:53 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1238 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:54.954514 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:54.955310 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:54.967176 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:54.969475 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:54.973461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:54.977073 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:55.229877 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-74b9572f-4784-431a-a623-704822d3892e tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:55.230708 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-74b9572f-4784-431a-a623-704822d3892e tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:55.238222 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b9572f-4784-431a-a623-704822d3892e tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:55.238803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b9572f-4784-431a-a623-704822d3892e tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:55.239712 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b9572f-4784-431a-a623-704822d3892e tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:55.240453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b9572f-4784-431a-a623-704822d3892e tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:55.427200 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-74b9572f-4784-431a-a623-704822d3892e tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:55.444905 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-74b9572f-4784-431a-a623-704822d3892e tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1272 microversion: 2.1 time: 0.218889 Jun 21 16:48:55.448451 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 18/31] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:55 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:55.567100 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:55.582696 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:55.586559 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:55.590159 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-22f20272-5d0a-424a-ac2d-4bb5df61b5a7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1333 microversion: 2.20 time: 0.639860 Jun 21 16:48:55.606957 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 14/32] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:48:54 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1333 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:48:55.702547 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d8d65572-4d02-4baf-a791-1105d4280567 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:55.703406 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d8d65572-4d02-4baf-a791-1105d4280567 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:55.729062 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d8d65572-4d02-4baf-a791-1105d4280567 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:55.741319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d8d65572-4d02-4baf-a791-1105d4280567 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:55.743813 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d8d65572-4d02-4baf-a791-1105d4280567 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:55.745065 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d8d65572-4d02-4baf-a791-1105d4280567 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:55.755836 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a06b68bc-9899-43fb-974f-481a19585b80 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:55.756874 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a06b68bc-9899-43fb-974f-481a19585b80 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:55.781569 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a06b68bc-9899-43fb-974f-481a19585b80 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:55.781569 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a06b68bc-9899-43fb-974f-481a19585b80 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:55.784730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a06b68bc-9899-43fb-974f-481a19585b80 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:55.789013 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a06b68bc-9899-43fb-974f-481a19585b80 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:56.033185 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a06b68bc-9899-43fb-974f-481a19585b80 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:56.061036 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a06b68bc-9899-43fb-974f-481a19585b80 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1242 microversion: 2.1 time: 0.308676 Jun 21 16:48:56.066785 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 15/33] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:55 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1242 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:56.470622 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-285f043c-18aa-4a4f-bae6-499d509932d8 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:56.470908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d8d65572-4d02-4baf-a791-1105d4280567 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:56.471579 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-285f043c-18aa-4a4f-bae6-499d509932d8 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:56.487916 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-285f043c-18aa-4a4f-bae6-499d509932d8 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:56.490636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-285f043c-18aa-4a4f-bae6-499d509932d8 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:56.491740 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-285f043c-18aa-4a4f-bae6-499d509932d8 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:56.493446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-285f043c-18aa-4a4f-bae6-499d509932d8 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:56.494912 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d8d65572-4d02-4baf-a791-1105d4280567 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1280 microversion: 2.1 time: 0.791198 Jun 21 16:48:56.518730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 19/34] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:55 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1280 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:56.617018 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:56.618458 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:56.631259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:56.631928 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:56.637990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:56.638558 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:56.660504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-285f043c-18aa-4a4f-bae6-499d509932d8 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:56.672966 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-285f043c-18aa-4a4f-bae6-499d509932d8 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1272 microversion: 2.1 time: 0.206875 Jun 21 16:48:56.677857 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 16/35] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:56 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:56.834972 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:56.854388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:56.864734 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:56.867121 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8ca02d12-bed5-4c26-901d-25f481383cc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1339 microversion: 2.20 time: 0.254070 Jun 21 16:48:56.880584 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 20/36] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:48:56 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1339 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:48:57.093122 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cc3f13d9-77bb-483f-946e-f47fe81baa5e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:57.094241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cc3f13d9-77bb-483f-946e-f47fe81baa5e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:57.108559 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc3f13d9-77bb-483f-946e-f47fe81baa5e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:57.146801 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc3f13d9-77bb-483f-946e-f47fe81baa5e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:57.146801 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc3f13d9-77bb-483f-946e-f47fe81baa5e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:57.146801 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc3f13d9-77bb-483f-946e-f47fe81baa5e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:57.453370 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cc3f13d9-77bb-483f-946e-f47fe81baa5e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:57.514473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cc3f13d9-77bb-483f-946e-f47fe81baa5e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1290 microversion: 2.1 time: 0.375308 Jun 21 16:48:57.514473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 17/37] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:57 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1290 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:57.534545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e47a0efa-3ea0-4727-a7f0-fb04c8883256 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:57.536488 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e47a0efa-3ea0-4727-a7f0-fb04c8883256 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:57.546075 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e47a0efa-3ea0-4727-a7f0-fb04c8883256 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:57.547209 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e47a0efa-3ea0-4727-a7f0-fb04c8883256 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:57.549478 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e47a0efa-3ea0-4727-a7f0-fb04c8883256 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:57.550551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e47a0efa-3ea0-4727-a7f0-fb04c8883256 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:57.693864 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e47a0efa-3ea0-4727-a7f0-fb04c8883256 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:57.701031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0e5f8e09-f53a-446b-afc1-d1d72a98f2bc tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:57.703239 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0e5f8e09-f53a-446b-afc1-d1d72a98f2bc tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:57.718036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e47a0efa-3ea0-4727-a7f0-fb04c8883256 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1280 microversion: 2.1 time: 0.187047 Jun 21 16:48:57.727852 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 21/38] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:57 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:57.728733 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0e5f8e09-f53a-446b-afc1-d1d72a98f2bc tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:57.728733 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0e5f8e09-f53a-446b-afc1-d1d72a98f2bc tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:57.728989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0e5f8e09-f53a-446b-afc1-d1d72a98f2bc tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:57.732122 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0e5f8e09-f53a-446b-afc1-d1d72a98f2bc tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:57.887572 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:57.888565 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:57.915214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:57.915997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:57.923021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:57.923839 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:58.117373 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:58.135499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:58.139582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:58.141272 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ca1aab74-d82b-4116-b7a4-140ab971d311 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1339 microversion: 2.20 time: 0.258692 Jun 21 16:48:58.155315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 22/39] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:48:57 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1339 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:48:58.300060 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0e5f8e09-f53a-446b-afc1-d1d72a98f2bc tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:58.310004 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0e5f8e09-f53a-446b-afc1-d1d72a98f2bc tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.621974 Jun 21 16:48:58.310609 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 18/40] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:57 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:58.537566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-156a1dc1-0e0a-435c-b008-3d54f6ce9316 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:58.540469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-156a1dc1-0e0a-435c-b008-3d54f6ce9316 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:58.551624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-156a1dc1-0e0a-435c-b008-3d54f6ce9316 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:58.552083 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-156a1dc1-0e0a-435c-b008-3d54f6ce9316 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:58.557857 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-156a1dc1-0e0a-435c-b008-3d54f6ce9316 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:58.558355 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-156a1dc1-0e0a-435c-b008-3d54f6ce9316 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:58.737268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e12b1b01-6ce3-47c8-9961-bdb622a7f209 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:58.738340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e12b1b01-6ce3-47c8-9961-bdb622a7f209 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:58.749716 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e12b1b01-6ce3-47c8-9961-bdb622a7f209 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:58.750535 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e12b1b01-6ce3-47c8-9961-bdb622a7f209 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:58.753620 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e12b1b01-6ce3-47c8-9961-bdb622a7f209 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:58.754357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e12b1b01-6ce3-47c8-9961-bdb622a7f209 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:58.756046 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-156a1dc1-0e0a-435c-b008-3d54f6ce9316 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:58.765721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-156a1dc1-0e0a-435c-b008-3d54f6ce9316 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1296 microversion: 2.1 time: 0.232158 Jun 21 16:48:58.776674 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 23/41] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:58 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1296 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:48:59.011812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e12b1b01-6ce3-47c8-9961-bdb622a7f209 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:59.024287 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e12b1b01-6ce3-47c8-9961-bdb622a7f209 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1280 microversion: 2.1 time: 0.292219 Jun 21 16:48:59.029427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 19/42] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:58 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1280 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:48:59.171772 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:59.172511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:59.180569 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:59.181191 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:59.182083 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:59.182893 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:59.295087 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:59.308054 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:59.310695 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:48:59.312483 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-48f0f8c5-8622-4f28-b049-6d0a67eed131 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1339 microversion: 2.20 time: 0.156075 Jun 21 16:48:59.313317 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 24/43] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:48:59 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:48:59.328678 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1a352af5-decf-45d7-aa9e-d32a47b39be2 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:59.336366 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1a352af5-decf-45d7-aa9e-d32a47b39be2 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:59.336366 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a352af5-decf-45d7-aa9e-d32a47b39be2 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:59.342224 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a352af5-decf-45d7-aa9e-d32a47b39be2 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:59.343069 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a352af5-decf-45d7-aa9e-d32a47b39be2 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:59.343520 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a352af5-decf-45d7-aa9e-d32a47b39be2 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:59.794926 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ef10d7fe-41ff-4764-9810-7bb56c2464ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:48:59.797002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ef10d7fe-41ff-4764-9810-7bb56c2464ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:48:59.808091 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ef10d7fe-41ff-4764-9810-7bb56c2464ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:59.808940 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ef10d7fe-41ff-4764-9810-7bb56c2464ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:48:59.812050 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ef10d7fe-41ff-4764-9810-7bb56c2464ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:48:59.812785 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ef10d7fe-41ff-4764-9810-7bb56c2464ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:00.068941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ef10d7fe-41ff-4764-9810-7bb56c2464ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:00.078440 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ef10d7fe-41ff-4764-9810-7bb56c2464ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1296 microversion: 2.1 time: 0.288636 Jun 21 16:49:00.079508 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 25/44] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:59 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1296 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:00.085495 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-24dba19b-161d-422f-8911-223bc6236d3f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:00.086507 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-24dba19b-161d-422f-8911-223bc6236d3f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:00.093547 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:00.107548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24dba19b-161d-422f-8911-223bc6236d3f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:00.107548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24dba19b-161d-422f-8911-223bc6236d3f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:00.107548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24dba19b-161d-422f-8911-223bc6236d3f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:00.107548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24dba19b-161d-422f-8911-223bc6236d3f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:00.257103 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-24dba19b-161d-422f-8911-223bc6236d3f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:00.279307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-24dba19b-161d-422f-8911-223bc6236d3f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1280 microversion: 2.1 time: 0.194432 Jun 21 16:49:00.302491 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 26/45] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:00 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1280 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:00.331920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:00.338417 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:00.348132 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:00.348999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:00.350197 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:00.350909 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:00.356571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1a352af5-decf-45d7-aa9e-d32a47b39be2 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:00.371970 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1a352af5-decf-45d7-aa9e-d32a47b39be2 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 1.047458 Jun 21 16:49:00.375593 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 20/46] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:48:59 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:00.481518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=6 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:00.492617 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:00.508675 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:00.513861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:00.517547 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c0841be6-774f-413b-bfa7-e46065a8e506 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1339 microversion: 2.20 time: 0.189726 Jun 21 16:49:00.520220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 27/47] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:00 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1339 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:49:01.099451 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1307f730-9b64-48aa-9d29-906920e4c2cd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:01.100124 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1307f730-9b64-48aa-9d29-906920e4c2cd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:01.122651 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1307f730-9b64-48aa-9d29-906920e4c2cd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:01.135160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1307f730-9b64-48aa-9d29-906920e4c2cd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:01.148789 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1307f730-9b64-48aa-9d29-906920e4c2cd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:01.148789 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1307f730-9b64-48aa-9d29-906920e4c2cd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:01.308294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7c2ff7d2-ed3b-4306-b7e4-65f50d648d1e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:01.327478 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7c2ff7d2-ed3b-4306-b7e4-65f50d648d1e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:01.367783 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7c2ff7d2-ed3b-4306-b7e4-65f50d648d1e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:01.375018 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7c2ff7d2-ed3b-4306-b7e4-65f50d648d1e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:01.383185 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7c2ff7d2-ed3b-4306-b7e4-65f50d648d1e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:01.383970 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7c2ff7d2-ed3b-4306-b7e4-65f50d648d1e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:02.246223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7c2ff7d2-ed3b-4306-b7e4-65f50d648d1e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:02.283489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7c2ff7d2-ed3b-4306-b7e4-65f50d648d1e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.979629 Jun 21 16:49:02.305905 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 28/48] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:01 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:02.314112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bc694746-c501-4e0e-befa-c0f9f678a879 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:02.316946 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-bc694746-c501-4e0e-befa-c0f9f678a879 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:02.337816 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bc694746-c501-4e0e-befa-c0f9f678a879 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:02.339865 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bc694746-c501-4e0e-befa-c0f9f678a879 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:02.340774 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bc694746-c501-4e0e-befa-c0f9f678a879 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:02.341744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bc694746-c501-4e0e-befa-c0f9f678a879 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:02.402894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=100 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:02.662424 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1307f730-9b64-48aa-9d29-906920e4c2cd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:02.675811 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1307f730-9b64-48aa-9d29-906920e4c2cd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 1.583441 Jun 21 16:49:02.684766 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 21/49] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:01 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:02.685671 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-bc694746-c501-4e0e-befa-c0f9f678a879 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:02.696394 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-bc694746-c501-4e0e-befa-c0f9f678a879 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.389301 Jun 21 16:49:02.698351 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 29/50] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:02 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:02.711863 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:02.712894 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:02.722644 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:02.724376 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:02.725189 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:02.726157 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:02.726638 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:03.104267 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=4 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:03.172845 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=24 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:03.312607 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-237a4a01-ec02-4d76-a9fb-993173b051f7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:03.313825 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-237a4a01-ec02-4d76-a9fb-993173b051f7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:03.331237 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-237a4a01-ec02-4d76-a9fb-993173b051f7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:03.333759 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-237a4a01-ec02-4d76-a9fb-993173b051f7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:03.335725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-237a4a01-ec02-4d76-a9fb-993173b051f7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:03.339275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-237a4a01-ec02-4d76-a9fb-993173b051f7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:04.049380 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:04.085081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:04.093546 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:04.096700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-48fd28be-52b9-4e27-aba4-dc79655072fa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 1.410143 Jun 21 16:49:04.100170 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 22/51] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:02 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:04.113781 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-401ad663-4f86-4b3c-9341-4f500ee5c54a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:04.114405 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-401ad663-4f86-4b3c-9341-4f500ee5c54a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:04.132704 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-401ad663-4f86-4b3c-9341-4f500ee5c54a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:04.133600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-401ad663-4f86-4b3c-9341-4f500ee5c54a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:04.136768 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-401ad663-4f86-4b3c-9341-4f500ee5c54a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:04.137514 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-401ad663-4f86-4b3c-9341-4f500ee5c54a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:04.184162 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-237a4a01-ec02-4d76-a9fb-993173b051f7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:04.185574 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-237a4a01-ec02-4d76-a9fb-993173b051f7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.880741 Jun 21 16:49:04.186915 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 30/52] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:03 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:04.194134 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3b4979f6-ded1-419f-94c5-54bd030ad61b tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:04.194810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3b4979f6-ded1-419f-94c5-54bd030ad61b tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:04.202647 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b4979f6-ded1-419f-94c5-54bd030ad61b tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:04.203563 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b4979f6-ded1-419f-94c5-54bd030ad61b tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:04.204745 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b4979f6-ded1-419f-94c5-54bd030ad61b tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:04.205519 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b4979f6-ded1-419f-94c5-54bd030ad61b tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:04.732617 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=30 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:04.896083 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3b4979f6-ded1-419f-94c5-54bd030ad61b tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:04.904019 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3b4979f6-ded1-419f-94c5-54bd030ad61b tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.714548 Jun 21 16:49:04.918210 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 31/53] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:04 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:05.430651 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-69f1edad-ff5f-4565-8e21-6591b7f6f51c req-9ed9beb8-6800-4001-a804-398b1692b832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f605003b-48fd-4e3f-9f19-462e7b713558", "tag": "a340b6f8-fea6-4847-a4cd-7d1ef896ed71"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:05.452275 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-401ad663-4f86-4b3c-9341-4f500ee5c54a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:05.466984 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-69f1edad-ff5f-4565-8e21-6591b7f6f51c req-9ed9beb8-6800-4001-a804-398b1692b832 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:05.467987 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-69f1edad-ff5f-4565-8e21-6591b7f6f51c req-9ed9beb8-6800-4001-a804-398b1692b832 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:05.482013 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-401ad663-4f86-4b3c-9341-4f500ee5c54a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 1.366195 Jun 21 16:49:05.493697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 23/54] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:04 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:05.500861 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:05.516087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:05.516087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:05.516087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:05.516087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:05.516547 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:05.516619 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-69f1edad-ff5f-4565-8e21-6591b7f6f51c req-9ed9beb8-6800-4001-a804-398b1692b832 service nova] Creating event network-changed:a340b6f8-fea6-4847-a4cd-7d1ef896ed71 for instance f605003b-48fd-4e3f-9f19-462e7b713558 on hv-cinder-79987 Jun 21 16:49:05.516946 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-69f1edad-ff5f-4565-8e21-6591b7f6f51c req-9ed9beb8-6800-4001-a804-398b1692b832 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124685) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 16:49:05.548943 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-deffb6ab-ce8e-40ac-9528-edf0a4888483 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:05.549429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-deffb6ab-ce8e-40ac-9528-edf0a4888483 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:05.551991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-deffb6ab-ce8e-40ac-9528-edf0a4888483 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:05.553555 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-deffb6ab-ce8e-40ac-9528-edf0a4888483 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:05.606696 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.compute.rpcapi [None req-deffb6ab-ce8e-40ac-9528-edf0a4888483 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 16:49:05.610006 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-deffb6ab-ce8e-40ac-9528-edf0a4888483 None None] Releasing lock "compute-rpcapi-router" {{(pid=124685) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 16:49:05.681618 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-deffb6ab-ce8e-40ac-9528-edf0a4888483 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.760853 Jun 21 16:49:05.682716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 32/55] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:49:05.701827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ae62313b-7640-4c3a-af55-1cc6aafebd36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:05.703567 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ae62313b-7640-4c3a-af55-1cc6aafebd36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:05.720429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae62313b-7640-4c3a-af55-1cc6aafebd36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:05.734166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae62313b-7640-4c3a-af55-1cc6aafebd36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:05.737152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae62313b-7640-4c3a-af55-1cc6aafebd36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:05.737953 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae62313b-7640-4c3a-af55-1cc6aafebd36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:06.427769 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ae62313b-7640-4c3a-af55-1cc6aafebd36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:06.442236 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ae62313b-7640-4c3a-af55-1cc6aafebd36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.753216 Jun 21 16:49:06.443867 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 33/56] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:05 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:06.472017 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:06.482654 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:06.485328 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:06.486497 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6f98b58b-4878-42cb-9deb-8a0cdad81d54 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.991699 Jun 21 16:49:06.487110 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 24/57] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:05 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:06.508185 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1b1b3be2-5d35-41e0-af69-aaa56a58c364 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:06.509066 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1b1b3be2-5d35-41e0-af69-aaa56a58c364 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:06.516462 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b1b3be2-5d35-41e0-af69-aaa56a58c364 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:06.517580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b1b3be2-5d35-41e0-af69-aaa56a58c364 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:06.518480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b1b3be2-5d35-41e0-af69-aaa56a58c364 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:06.519109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b1b3be2-5d35-41e0-af69-aaa56a58c364 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:06.689346 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-d54b2619-c728-41c5-b2ac-5e540cb6504c req-72aee607-ac11-451f-8ebf-e557617a5757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d316a40-ffbf-47fa-83b7-58afe1fc093d", "tag": "6016e0b6-cbeb-464d-bd9e-9bd83c250e62"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:06.713727 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-d54b2619-c728-41c5-b2ac-5e540cb6504c req-72aee607-ac11-451f-8ebf-e557617a5757 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:06.714875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-d54b2619-c728-41c5-b2ac-5e540cb6504c req-72aee607-ac11-451f-8ebf-e557617a5757 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:06.742240 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-d54b2619-c728-41c5-b2ac-5e540cb6504c req-72aee607-ac11-451f-8ebf-e557617a5757 service nova] Creating event network-changed:6016e0b6-cbeb-464d-bd9e-9bd83c250e62 for instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d on hv-cinder-79987 Jun 21 16:49:06.755923 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-d54b2619-c728-41c5-b2ac-5e540cb6504c req-72aee607-ac11-451f-8ebf-e557617a5757 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308082 Jun 21 16:49:06.755923 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 34/58] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:49:06.763502 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-003873b4-4bde-410f-a527-575ee73f6221 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:06.764832 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-003873b4-4bde-410f-a527-575ee73f6221 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:06.776381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-003873b4-4bde-410f-a527-575ee73f6221 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:06.777643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-003873b4-4bde-410f-a527-575ee73f6221 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:06.778856 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-003873b4-4bde-410f-a527-575ee73f6221 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:06.779802 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-003873b4-4bde-410f-a527-575ee73f6221 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:07.147524 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-003873b4-4bde-410f-a527-575ee73f6221 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:07.164952 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-003873b4-4bde-410f-a527-575ee73f6221 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.407648 Jun 21 16:49:07.166545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 35/59] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:06 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:07.413195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1b1b3be2-5d35-41e0-af69-aaa56a58c364 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:07.418395 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=100 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:07.424671 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1b1b3be2-5d35-41e0-af69-aaa56a58c364 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.936461 Jun 21 16:49:07.425645 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 25/60] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:06 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:07.461585 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e97ebcfb-d522-44ac-84ea-6851372c45aa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:07.462478 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e97ebcfb-d522-44ac-84ea-6851372c45aa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:07.479996 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e97ebcfb-d522-44ac-84ea-6851372c45aa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:07.480851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e97ebcfb-d522-44ac-84ea-6851372c45aa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:07.481963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e97ebcfb-d522-44ac-84ea-6851372c45aa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:07.482960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e97ebcfb-d522-44ac-84ea-6851372c45aa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:07.505529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:07.511302 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:07.538297 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:07.539220 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:07.540216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:07.540730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:07.756953 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e97ebcfb-d522-44ac-84ea-6851372c45aa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:07.788281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e97ebcfb-d522-44ac-84ea-6851372c45aa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.331835 Jun 21 16:49:07.792096 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 36/61] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:07 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:08.193940 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-879e015e-fc59-4272-8ab1-fecd45e49b5c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:08.200352 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-879e015e-fc59-4272-8ab1-fecd45e49b5c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:08.225603 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-879e015e-fc59-4272-8ab1-fecd45e49b5c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:08.226304 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-879e015e-fc59-4272-8ab1-fecd45e49b5c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:08.227237 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-879e015e-fc59-4272-8ab1-fecd45e49b5c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:08.227844 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-879e015e-fc59-4272-8ab1-fecd45e49b5c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:08.410633 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:08.438970 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:08.443481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:08.450590 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6a7ee028-0076-44ca-b9c8-4f649a70a4cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.944522 Jun 21 16:49:08.451528 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 26/62] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:07 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:08.465730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3d67f1a1-ab5e-4d08-94ba-45233056eb5a tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:08.465730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3d67f1a1-ab5e-4d08-94ba-45233056eb5a tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:08.499545 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d67f1a1-ab5e-4d08-94ba-45233056eb5a tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:08.500002 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d67f1a1-ab5e-4d08-94ba-45233056eb5a tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:08.500872 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d67f1a1-ab5e-4d08-94ba-45233056eb5a tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:08.501326 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d67f1a1-ab5e-4d08-94ba-45233056eb5a tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:08.528488 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-879e015e-fc59-4272-8ab1-fecd45e49b5c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:08.546614 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-879e015e-fc59-4272-8ab1-fecd45e49b5c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.365080 Jun 21 16:49:08.549473 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 37/63] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:08 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:08.809823 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-57b582be-b889-4e1d-bb98-fa7121f62171 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:08.810480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-57b582be-b889-4e1d-bb98-fa7121f62171 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:08.816648 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-57b582be-b889-4e1d-bb98-fa7121f62171 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:08.817090 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-57b582be-b889-4e1d-bb98-fa7121f62171 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:08.817898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-57b582be-b889-4e1d-bb98-fa7121f62171 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:08.818313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-57b582be-b889-4e1d-bb98-fa7121f62171 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:08.845323 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3d67f1a1-ab5e-4d08-94ba-45233056eb5a tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:08.854659 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3d67f1a1-ab5e-4d08-94ba-45233056eb5a tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.402037 Jun 21 16:49:08.855777 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 27/64] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:08 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:08.861339 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-4b3c4d46-e26a-4106-b4b0-a798aad2853e req-f8ab1d37-49b6-4cb8-b648-a3597bf213ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12e3b57-72af-4292-ba65-d90c166a49ed", "tag": "4c3527eb-ca57-4f3c-ac3f-f1b1d9060481"}, {"name": "network-changed", "server_uuid": "f3358207-e4db-4c88-b56b-05f718c39a8e", "tag": "1382e7bf-7f7f-4cf3-a568-1e6303eb5b15"}, {"name": "network-changed", "server_uuid": "0d9af742-a7f3-4113-8ace-571502dad309", "tag": "7b305906-1977-410d-88f8-b281cb089050"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:08.877612 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-4b3c4d46-e26a-4106-b4b0-a798aad2853e req-f8ab1d37-49b6-4cb8-b648-a3597bf213ab service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:08.878046 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-4b3c4d46-e26a-4106-b4b0-a798aad2853e req-f8ab1d37-49b6-4cb8-b648-a3597bf213ab service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:08.919403 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-4b3c4d46-e26a-4106-b4b0-a798aad2853e req-f8ab1d37-49b6-4cb8-b648-a3597bf213ab service nova] Creating event network-changed:4c3527eb-ca57-4f3c-ac3f-f1b1d9060481 for instance b12e3b57-72af-4292-ba65-d90c166a49ed on hv-cinder-79987 Jun 21 16:49:08.919909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-4b3c4d46-e26a-4106-b4b0-a798aad2853e req-f8ab1d37-49b6-4cb8-b648-a3597bf213ab service nova] Creating event network-changed:1382e7bf-7f7f-4cf3-a568-1e6303eb5b15 for instance f3358207-e4db-4c88-b56b-05f718c39a8e on hv-cinder-79987 Jun 21 16:49:08.920390 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-4b3c4d46-e26a-4106-b4b0-a798aad2853e req-f8ab1d37-49b6-4cb8-b648-a3597bf213ab service nova] Creating event network-changed:7b305906-1977-410d-88f8-b281cb089050 for instance 0d9af742-a7f3-4113-8ace-571502dad309 on hv-cinder-79987 Jun 21 16:49:08.921921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-4b3c4d46-e26a-4106-b4b0-a798aad2853e req-f8ab1d37-49b6-4cb8-b648-a3597bf213ab service nova] Acquired lock "compute-rpcapi-router" {{(pid=124686) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 16:49:08.923295 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1dcb031-0404-45eb-8bb6-e0c1bf9641a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:08.923740 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1dcb031-0404-45eb-8bb6-e0c1bf9641a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:08.924549 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1dcb031-0404-45eb-8bb6-e0c1bf9641a7 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:08.928332 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1dcb031-0404-45eb-8bb6-e0c1bf9641a7 None None] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:08.952172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.compute.rpcapi [None req-b1dcb031-0404-45eb-8bb6-e0c1bf9641a7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 16:49:08.953085 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1dcb031-0404-45eb-8bb6-e0c1bf9641a7 None None] Releasing lock "compute-rpcapi-router" {{(pid=124686) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 16:49:08.974078 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b1dcb031-0404-45eb-8bb6-e0c1bf9641a7 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.116786 Jun 21 16:49:08.976280 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 28/65] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:49:09.048589 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-57b582be-b889-4e1d-bb98-fa7121f62171 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:09.057809 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-57b582be-b889-4e1d-bb98-fa7121f62171 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.251847 Jun 21 16:49:09.071732 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 38/66] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:08 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:09.471882 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:09.472708 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:09.481241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:09.485481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:09.485481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:09.485481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:09.568760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b3ca15bb-9497-4c57-aa24-262ad28abe3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:09.569412 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b3ca15bb-9497-4c57-aa24-262ad28abe3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:09.578706 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b3ca15bb-9497-4c57-aa24-262ad28abe3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:09.579154 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b3ca15bb-9497-4c57-aa24-262ad28abe3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:09.582435 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b3ca15bb-9497-4c57-aa24-262ad28abe3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:09.582963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b3ca15bb-9497-4c57-aa24-262ad28abe3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:09.752679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b3ca15bb-9497-4c57-aa24-262ad28abe3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:09.761269 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b3ca15bb-9497-4c57-aa24-262ad28abe3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.199576 Jun 21 16:49:09.762054 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 39/67] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:09 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:09.801654 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:09.809575 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:09.811085 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:09.812172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3308546a-bf3f-470b-91ea-42844c543bb7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.346160 Jun 21 16:49:09.813087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 29/68] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:09 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:09.871318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c2ee45d4-c1a8-4e80-b684-f99e4f1114a3 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:09.871924 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c2ee45d4-c1a8-4e80-b684-f99e4f1114a3 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:09.878228 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c2ee45d4-c1a8-4e80-b684-f99e4f1114a3 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:09.878679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c2ee45d4-c1a8-4e80-b684-f99e4f1114a3 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:09.879444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c2ee45d4-c1a8-4e80-b684-f99e4f1114a3 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:09.879879 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c2ee45d4-c1a8-4e80-b684-f99e4f1114a3 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:10.017382 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c2ee45d4-c1a8-4e80-b684-f99e4f1114a3 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:10.026884 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c2ee45d4-c1a8-4e80-b684-f99e4f1114a3 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.159335 Jun 21 16:49:10.027480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 40/69] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:09 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:10.075350 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-16f0a810-86a4-42f1-8a17-8d0412066257 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:10.075983 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-16f0a810-86a4-42f1-8a17-8d0412066257 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:10.083124 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-16f0a810-86a4-42f1-8a17-8d0412066257 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:10.087107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-16f0a810-86a4-42f1-8a17-8d0412066257 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:10.087107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-16f0a810-86a4-42f1-8a17-8d0412066257 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:10.087107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-16f0a810-86a4-42f1-8a17-8d0412066257 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:10.221880 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-16f0a810-86a4-42f1-8a17-8d0412066257 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:10.230292 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-16f0a810-86a4-42f1-8a17-8d0412066257 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.158862 Jun 21 16:49:10.231455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 30/70] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:10 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:10.778492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a9fc7ac0-2cc1-45af-bc46-13863f212d67 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:10.779098 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a9fc7ac0-2cc1-45af-bc46-13863f212d67 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:10.785548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a9fc7ac0-2cc1-45af-bc46-13863f212d67 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:10.786060 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a9fc7ac0-2cc1-45af-bc46-13863f212d67 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:10.786857 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a9fc7ac0-2cc1-45af-bc46-13863f212d67 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:10.787294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a9fc7ac0-2cc1-45af-bc46-13863f212d67 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:10.831092 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:10.831706 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:10.837727 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:10.838172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:10.839198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:10.839632 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:10.929156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a9fc7ac0-2cc1-45af-bc46-13863f212d67 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:10.941689 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a9fc7ac0-2cc1-45af-bc46-13863f212d67 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.166788 Jun 21 16:49:10.942462 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 41/71] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:10 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:10.986061 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:10.994832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:10.995826 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:10.996958 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-43bedb30-f71a-4a14-9e9d-4a849d7603b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.170815 Jun 21 16:49:10.997737 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 31/72] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:10 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:49:11.044950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bda652f6-17e3-4eb5-aac6-5513e9193b29 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:11.045668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-bda652f6-17e3-4eb5-aac6-5513e9193b29 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:11.052554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bda652f6-17e3-4eb5-aac6-5513e9193b29 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:11.053156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bda652f6-17e3-4eb5-aac6-5513e9193b29 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:11.054252 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bda652f6-17e3-4eb5-aac6-5513e9193b29 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:11.054750 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bda652f6-17e3-4eb5-aac6-5513e9193b29 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:11.201721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-bda652f6-17e3-4eb5-aac6-5513e9193b29 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:11.209956 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-bda652f6-17e3-4eb5-aac6-5513e9193b29 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.169004 Jun 21 16:49:11.210519 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 42/73] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:11 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:11.248105 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1cffc8c6-4c78-478d-88b8-0d707dc2e2f5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:11.248649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1cffc8c6-4c78-478d-88b8-0d707dc2e2f5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:11.254844 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1cffc8c6-4c78-478d-88b8-0d707dc2e2f5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:11.255295 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1cffc8c6-4c78-478d-88b8-0d707dc2e2f5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:11.256081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1cffc8c6-4c78-478d-88b8-0d707dc2e2f5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:11.256514 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1cffc8c6-4c78-478d-88b8-0d707dc2e2f5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:11.923228 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1cffc8c6-4c78-478d-88b8-0d707dc2e2f5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:11.938560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1cffc8c6-4c78-478d-88b8-0d707dc2e2f5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.694288 Jun 21 16:49:11.941948 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 32/74] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:11 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:11.959241 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b7c3740c-6979-4936-83f1-9330b1d44132 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:11.959842 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b7c3740c-6979-4936-83f1-9330b1d44132 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:11.966655 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b7c3740c-6979-4936-83f1-9330b1d44132 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:11.967328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b7c3740c-6979-4936-83f1-9330b1d44132 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:11.968463 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b7c3740c-6979-4936-83f1-9330b1d44132 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:11.968899 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b7c3740c-6979-4936-83f1-9330b1d44132 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:12.022793 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:12.023415 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:12.031124 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:12.031824 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:12.033193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:12.033984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:12.136999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b7c3740c-6979-4936-83f1-9330b1d44132 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:12.147942 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b7c3740c-6979-4936-83f1-9330b1d44132 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.190641 Jun 21 16:49:12.147942 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 43/75] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:11 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:12.234263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0c788d86-c9e9-41dc-85a1-2f605c4179a7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:12.236908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0c788d86-c9e9-41dc-85a1-2f605c4179a7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:12.254064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0c788d86-c9e9-41dc-85a1-2f605c4179a7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:12.255594 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0c788d86-c9e9-41dc-85a1-2f605c4179a7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:12.257528 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0c788d86-c9e9-41dc-85a1-2f605c4179a7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:12.259619 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0c788d86-c9e9-41dc-85a1-2f605c4179a7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:12.445673 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:12.461303 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:12.464884 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0c788d86-c9e9-41dc-85a1-2f605c4179a7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:12.465744 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:12.470028 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-25b2f2c9-0e81-4c4f-893f-7b24d124c7dd tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.456137 Jun 21 16:49:12.472988 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 33/76] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:12 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:49:12.494701 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0c788d86-c9e9-41dc-85a1-2f605c4179a7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.268694 Jun 21 16:49:12.495284 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 44/77] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:12 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:12.957992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8a57e90b-1e17-486b-ae03-946b72618ba9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:12.958524 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8a57e90b-1e17-486b-ae03-946b72618ba9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:12.964681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8a57e90b-1e17-486b-ae03-946b72618ba9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:12.965125 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8a57e90b-1e17-486b-ae03-946b72618ba9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:12.966633 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8a57e90b-1e17-486b-ae03-946b72618ba9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:12.967275 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8a57e90b-1e17-486b-ae03-946b72618ba9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:13.171253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c6aa6965-39bd-44d2-bd2d-517d21c86fd0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:13.171922 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c6aa6965-39bd-44d2-bd2d-517d21c86fd0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:13.181634 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c6aa6965-39bd-44d2-bd2d-517d21c86fd0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:13.185493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c6aa6965-39bd-44d2-bd2d-517d21c86fd0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:13.185493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c6aa6965-39bd-44d2-bd2d-517d21c86fd0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:13.185493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c6aa6965-39bd-44d2-bd2d-517d21c86fd0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:13.254210 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8a57e90b-1e17-486b-ae03-946b72618ba9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:13.264904 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8a57e90b-1e17-486b-ae03-946b72618ba9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.309922 Jun 21 16:49:13.274947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 34/78] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:12 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:13.438575 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c6aa6965-39bd-44d2-bd2d-517d21c86fd0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:13.450801 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c6aa6965-39bd-44d2-bd2d-517d21c86fd0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.287591 Jun 21 16:49:13.452020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 45/79] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:13 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:13.501952 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:13.503507 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:13.516107 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e515c2ff-489f-4692-b906-12fcef9ec53d tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:13.517999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e515c2ff-489f-4692-b906-12fcef9ec53d tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:13.530133 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e515c2ff-489f-4692-b906-12fcef9ec53d tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:13.545833 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e515c2ff-489f-4692-b906-12fcef9ec53d tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:13.549245 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e515c2ff-489f-4692-b906-12fcef9ec53d tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:13.549441 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e515c2ff-489f-4692-b906-12fcef9ec53d tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:13.559042 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:13.559042 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:13.560230 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:13.562018 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:13.728366 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:13.736763 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:13.738225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:13.739325 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b017a006-5f83-4565-9053-34006d6f7854 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.254127 Jun 21 16:49:13.740294 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 35/80] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:13 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:13.750514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e515c2ff-489f-4692-b906-12fcef9ec53d tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:13.758464 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e515c2ff-489f-4692-b906-12fcef9ec53d tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.246560 Jun 21 16:49:13.759023 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 46/81] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:13 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:14.283031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3bc97173-e578-4acd-8f11-5c46ad2e8c63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:14.283789 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3bc97173-e578-4acd-8f11-5c46ad2e8c63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:14.290296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3bc97173-e578-4acd-8f11-5c46ad2e8c63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:14.290734 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3bc97173-e578-4acd-8f11-5c46ad2e8c63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:14.291766 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3bc97173-e578-4acd-8f11-5c46ad2e8c63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:14.292212 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3bc97173-e578-4acd-8f11-5c46ad2e8c63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:14.470393 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c5756cbf-c84c-416f-9b15-b473cd45fecb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:14.471683 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c5756cbf-c84c-416f-9b15-b473cd45fecb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:14.477741 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5756cbf-c84c-416f-9b15-b473cd45fecb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:14.478186 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5756cbf-c84c-416f-9b15-b473cd45fecb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:14.478969 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5756cbf-c84c-416f-9b15-b473cd45fecb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:14.479396 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5756cbf-c84c-416f-9b15-b473cd45fecb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:14.483668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=100 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:14.551033 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3bc97173-e578-4acd-8f11-5c46ad2e8c63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:14.575227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3bc97173-e578-4acd-8f11-5c46ad2e8c63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.287716 Jun 21 16:49:14.575227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 36/82] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:14 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:14.655793 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c5756cbf-c84c-416f-9b15-b473cd45fecb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:14.668600 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c5756cbf-c84c-416f-9b15-b473cd45fecb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.202485 Jun 21 16:49:14.669720 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 47/83] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:14 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:14.757385 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:14.758029 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:14.764529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:14.764981 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:14.765823 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:14.766237 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:14.777020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8ec33ef1-6be4-4a04-b232-b4b51f1aff39 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:14.777949 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8ec33ef1-6be4-4a04-b232-b4b51f1aff39 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:14.785343 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ec33ef1-6be4-4a04-b232-b4b51f1aff39 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:14.786126 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ec33ef1-6be4-4a04-b232-b4b51f1aff39 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:14.786922 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ec33ef1-6be4-4a04-b232-b4b51f1aff39 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:14.787427 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ec33ef1-6be4-4a04-b232-b4b51f1aff39 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:15.081548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8ec33ef1-6be4-4a04-b232-b4b51f1aff39 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:15.092864 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8ec33ef1-6be4-4a04-b232-b4b51f1aff39 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.320017 Jun 21 16:49:15.096755 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 48/84] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:14 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:15.213681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:15.222833 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:15.225248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:15.226834 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1dfc5f12-0230-4b3c-b996-b787dd379436 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.473550 Jun 21 16:49:15.228028 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 37/85] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:14 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:15.538247 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-001b836d-4589-4d4f-90d4-363342f007af req-055abb06-4578-436f-9338-5333fb5d7656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d316a40-ffbf-47fa-83b7-58afe1fc093d", "name": "network-vif-plugged", "status": "completed", "tag": "6016e0b6-cbeb-464d-bd9e-9bd83c250e62"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:15.547855 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-001b836d-4589-4d4f-90d4-363342f007af req-055abb06-4578-436f-9338-5333fb5d7656 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:15.548718 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-001b836d-4589-4d4f-90d4-363342f007af req-055abb06-4578-436f-9338-5333fb5d7656 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:15.563890 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-001b836d-4589-4d4f-90d4-363342f007af req-055abb06-4578-436f-9338-5333fb5d7656 service nova] Creating event network-vif-plugged:6016e0b6-cbeb-464d-bd9e-9bd83c250e62 for instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d on hv-cinder-79987 Jun 21 16:49:15.569969 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-001b836d-4589-4d4f-90d4-363342f007af req-055abb06-4578-436f-9338-5333fb5d7656 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242995 Jun 21 16:49:15.571025 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 49/86] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:49:15.596968 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2dd04d4b-2f44-4a19-bd83-ffd49d7cc5ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:15.598517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2dd04d4b-2f44-4a19-bd83-ffd49d7cc5ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:15.608016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2dd04d4b-2f44-4a19-bd83-ffd49d7cc5ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:15.608401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2dd04d4b-2f44-4a19-bd83-ffd49d7cc5ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:15.609635 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2dd04d4b-2f44-4a19-bd83-ffd49d7cc5ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:15.610389 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2dd04d4b-2f44-4a19-bd83-ffd49d7cc5ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:15.683877 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:15.688393 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c8237c59-115d-4bb7-9a2e-802f1e86c88b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:15.689146 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c8237c59-115d-4bb7-9a2e-802f1e86c88b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:15.698951 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c8237c59-115d-4bb7-9a2e-802f1e86c88b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:15.699404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c8237c59-115d-4bb7-9a2e-802f1e86c88b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:15.700177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c8237c59-115d-4bb7-9a2e-802f1e86c88b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:15.700879 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c8237c59-115d-4bb7-9a2e-802f1e86c88b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:15.862877 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2dd04d4b-2f44-4a19-bd83-ffd49d7cc5ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:15.870599 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2dd04d4b-2f44-4a19-bd83-ffd49d7cc5ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.281123 Jun 21 16:49:15.880946 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c8237c59-115d-4bb7-9a2e-802f1e86c88b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:15.881690 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 38/87] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:15 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:15.889068 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c8237c59-115d-4bb7-9a2e-802f1e86c88b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.206388 Jun 21 16:49:15.889660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 50/88] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:15 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:16.112087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-55b97881-021f-4b2d-abbd-a74e9ee53df6 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:16.112644 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-55b97881-021f-4b2d-abbd-a74e9ee53df6 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:16.121454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55b97881-021f-4b2d-abbd-a74e9ee53df6 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:16.121935 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55b97881-021f-4b2d-abbd-a74e9ee53df6 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:16.122619 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55b97881-021f-4b2d-abbd-a74e9ee53df6 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:16.123051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55b97881-021f-4b2d-abbd-a74e9ee53df6 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:16.248414 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:16.249039 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:16.260288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:16.260834 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:16.261920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:16.262717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:16.294806 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-55b97881-021f-4b2d-abbd-a74e9ee53df6 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:16.303237 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-55b97881-021f-4b2d-abbd-a74e9ee53df6 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.195527 Jun 21 16:49:16.303823 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 39/89] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:16 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:16.448066 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:16.457112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:16.458656 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:16.459735 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-24807bd2-2323-4b6f-9e00-43c6ca6a41b1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.218219 Jun 21 16:49:16.460285 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 51/90] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:16 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:49:16.888182 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-992acda4-7d11-46b9-84b7-09ea6077818c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:16.889674 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-992acda4-7d11-46b9-84b7-09ea6077818c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:16.897165 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-992acda4-7d11-46b9-84b7-09ea6077818c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:16.897378 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-992acda4-7d11-46b9-84b7-09ea6077818c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:16.898153 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-992acda4-7d11-46b9-84b7-09ea6077818c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:16.898662 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-992acda4-7d11-46b9-84b7-09ea6077818c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:16.916299 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a6759a11-9618-45a2-ac3a-5fdde70f07e4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:16.918036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a6759a11-9618-45a2-ac3a-5fdde70f07e4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:16.926756 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a6759a11-9618-45a2-ac3a-5fdde70f07e4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:16.928547 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a6759a11-9618-45a2-ac3a-5fdde70f07e4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:16.929530 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a6759a11-9618-45a2-ac3a-5fdde70f07e4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:16.930104 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a6759a11-9618-45a2-ac3a-5fdde70f07e4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:17.080635 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-992acda4-7d11-46b9-84b7-09ea6077818c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:17.096191 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-992acda4-7d11-46b9-84b7-09ea6077818c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.211434 Jun 21 16:49:17.097051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 40/91] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:16 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:17.115968 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a6759a11-9618-45a2-ac3a-5fdde70f07e4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:17.124784 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a6759a11-9618-45a2-ac3a-5fdde70f07e4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.213065 Jun 21 16:49:17.125387 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 52/92] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:16 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:17.327545 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f3825cce-ff10-46a9-9747-f997f8b02263 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:17.328715 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f3825cce-ff10-46a9-9747-f997f8b02263 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:17.337239 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f3825cce-ff10-46a9-9747-f997f8b02263 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:17.337845 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f3825cce-ff10-46a9-9747-f997f8b02263 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:17.338628 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f3825cce-ff10-46a9-9747-f997f8b02263 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:17.339061 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f3825cce-ff10-46a9-9747-f997f8b02263 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:17.480214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:17.484033 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:17.498613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:17.505163 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:17.506114 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:17.506617 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:17.599376 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f3825cce-ff10-46a9-9747-f997f8b02263 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:17.612653 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f3825cce-ff10-46a9-9747-f997f8b02263 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.294401 Jun 21 16:49:17.622795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 41/93] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:17 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:17.631606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-95abd156-01d9-4ef5-af6b-8116676cfcfa req-2bae0617-5a09-4488-87b7-6362dd4dd66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12e3b57-72af-4292-ba65-d90c166a49ed", "name": "network-vif-plugged", "status": "completed", "tag": "4c3527eb-ca57-4f3c-ac3f-f1b1d9060481"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:17.656272 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-95abd156-01d9-4ef5-af6b-8116676cfcfa req-2bae0617-5a09-4488-87b7-6362dd4dd66f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:17.656710 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-95abd156-01d9-4ef5-af6b-8116676cfcfa req-2bae0617-5a09-4488-87b7-6362dd4dd66f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:17.675787 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-95abd156-01d9-4ef5-af6b-8116676cfcfa req-2bae0617-5a09-4488-87b7-6362dd4dd66f service nova] Creating event network-vif-plugged:4c3527eb-ca57-4f3c-ac3f-f1b1d9060481 for instance b12e3b57-72af-4292-ba65-d90c166a49ed on hv-cinder-79987 Jun 21 16:49:17.681366 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:17.685616 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-95abd156-01d9-4ef5-af6b-8116676cfcfa req-2bae0617-5a09-4488-87b7-6362dd4dd66f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061080 Jun 21 16:49:17.686585 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 42/94] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:49:17.693335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:17.694912 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:17.696233 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ee23691e-3073-4b0c-bbdf-a7e746538c41 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.221904 Jun 21 16:49:17.697368 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 53/95] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:17 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:18.114398 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9af93c55-88d1-43ad-8366-d8088fa122ba tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:18.115193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9af93c55-88d1-43ad-8366-d8088fa122ba tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:18.121918 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9af93c55-88d1-43ad-8366-d8088fa122ba tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:18.122557 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9af93c55-88d1-43ad-8366-d8088fa122ba tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:18.123436 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9af93c55-88d1-43ad-8366-d8088fa122ba tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:18.123939 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9af93c55-88d1-43ad-8366-d8088fa122ba tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:18.142230 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-99c2ab26-7ffe-4198-a70b-53650f730d70 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:18.143544 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=100 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:18.143707 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-99c2ab26-7ffe-4198-a70b-53650f730d70 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:18.153423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99c2ab26-7ffe-4198-a70b-53650f730d70 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:18.153423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99c2ab26-7ffe-4198-a70b-53650f730d70 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:18.153423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99c2ab26-7ffe-4198-a70b-53650f730d70 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:18.153423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99c2ab26-7ffe-4198-a70b-53650f730d70 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:18.281827 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9af93c55-88d1-43ad-8366-d8088fa122ba tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:18.291775 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9af93c55-88d1-43ad-8366-d8088fa122ba tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.182301 Jun 21 16:49:18.292829 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 43/96] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:18 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:18.301123 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-99c2ab26-7ffe-4198-a70b-53650f730d70 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:18.309036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-99c2ab26-7ffe-4198-a70b-53650f730d70 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.170530 Jun 21 16:49:18.309630 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 54/97] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:18 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:18.630916 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-10f0f769-2409-4174-bf21-bb431ab99471 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:18.631863 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-10f0f769-2409-4174-bf21-bb431ab99471 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:18.637833 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-10f0f769-2409-4174-bf21-bb431ab99471 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:18.638651 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-10f0f769-2409-4174-bf21-bb431ab99471 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:18.639436 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-10f0f769-2409-4174-bf21-bb431ab99471 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:18.640024 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-10f0f769-2409-4174-bf21-bb431ab99471 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:18.717076 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:18.718129 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:18.733437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:18.734135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:18.735246 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:18.735836 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:18.837114 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-10f0f769-2409-4174-bf21-bb431ab99471 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:18.845662 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-10f0f769-2409-4174-bf21-bb431ab99471 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.219226 Jun 21 16:49:18.855651 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 44/98] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:18 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:18.970969 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:18.980115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:18.981812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:18.982923 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0aace6b2-5196-4c8f-a63e-ccf144eacb11 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.270203 Jun 21 16:49:18.983789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 55/99] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:18 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:49:19.324418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1b905e95-9b31-404b-8b76-07e87b53606c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:19.325100 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1b905e95-9b31-404b-8b76-07e87b53606c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:19.326133 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d5f626ae-32d3-49ae-9935-05074da90631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:19.327079 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d5f626ae-32d3-49ae-9935-05074da90631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:19.334560 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d5f626ae-32d3-49ae-9935-05074da90631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:19.334799 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d5f626ae-32d3-49ae-9935-05074da90631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:19.335385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d5f626ae-32d3-49ae-9935-05074da90631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:19.336100 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d5f626ae-32d3-49ae-9935-05074da90631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:19.337188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:19.349741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b905e95-9b31-404b-8b76-07e87b53606c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:19.350193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b905e95-9b31-404b-8b76-07e87b53606c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:19.350959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b905e95-9b31-404b-8b76-07e87b53606c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:19.351385 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b905e95-9b31-404b-8b76-07e87b53606c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:19.495503 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d5f626ae-32d3-49ae-9935-05074da90631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:19.503599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d5f626ae-32d3-49ae-9935-05074da90631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.181669 Jun 21 16:49:19.504184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 56/100] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:19 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:19.557828 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1b905e95-9b31-404b-8b76-07e87b53606c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:19.569510 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1b905e95-9b31-404b-8b76-07e87b53606c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.262100 Jun 21 16:49:19.570270 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 45/101] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:19 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:19.872225 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-af7039a1-9c03-4d68-a9e1-459dcda6da06 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:19.872827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-af7039a1-9c03-4d68-a9e1-459dcda6da06 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:19.879837 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-af7039a1-9c03-4d68-a9e1-459dcda6da06 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:19.881027 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-af7039a1-9c03-4d68-a9e1-459dcda6da06 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:19.881305 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-af7039a1-9c03-4d68-a9e1-459dcda6da06 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:19.881740 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-af7039a1-9c03-4d68-a9e1-459dcda6da06 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:20.003718 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:20.004609 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:20.013188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:20.013188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:20.013188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:20.013188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:20.103572 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-af7039a1-9c03-4d68-a9e1-459dcda6da06 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:20.118733 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-af7039a1-9c03-4d68-a9e1-459dcda6da06 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.250453 Jun 21 16:49:20.119334 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 57/102] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:19 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:20.198539 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:20.207067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:20.208576 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:20.209730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f93a8754-8cd2-43d3-8f07-0a5b0be018d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.210244 Jun 21 16:49:20.210284 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 46/103] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:19 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:20.524173 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-71fbb1b9-bb81-4adb-86e5-4436c766eda1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:20.524733 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-71fbb1b9-bb81-4adb-86e5-4436c766eda1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:20.531361 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71fbb1b9-bb81-4adb-86e5-4436c766eda1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:20.531809 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71fbb1b9-bb81-4adb-86e5-4436c766eda1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:20.532582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71fbb1b9-bb81-4adb-86e5-4436c766eda1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:20.533053 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71fbb1b9-bb81-4adb-86e5-4436c766eda1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:20.587216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-15349859-7d75-44fc-b5ce-986f82647dc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:20.587905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-15349859-7d75-44fc-b5ce-986f82647dc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:20.594678 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15349859-7d75-44fc-b5ce-986f82647dc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:20.595402 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15349859-7d75-44fc-b5ce-986f82647dc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:20.596974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15349859-7d75-44fc-b5ce-986f82647dc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:20.597536 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15349859-7d75-44fc-b5ce-986f82647dc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:20.774937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-71fbb1b9-bb81-4adb-86e5-4436c766eda1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:20.782395 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-71fbb1b9-bb81-4adb-86e5-4436c766eda1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.266195 Jun 21 16:49:20.783150 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 58/104] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:20 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:20.790485 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-15349859-7d75-44fc-b5ce-986f82647dc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:20.798354 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-15349859-7d75-44fc-b5ce-986f82647dc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.215042 Jun 21 16:49:20.798929 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 47/105] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:20 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:21.135893 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a5cf869a-0a49-4a75-a6be-442a4bd5e292 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:21.136507 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a5cf869a-0a49-4a75-a6be-442a4bd5e292 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:21.142892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a5cf869a-0a49-4a75-a6be-442a4bd5e292 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:21.143831 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a5cf869a-0a49-4a75-a6be-442a4bd5e292 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:21.144635 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a5cf869a-0a49-4a75-a6be-442a4bd5e292 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:21.145012 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a5cf869a-0a49-4a75-a6be-442a4bd5e292 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:21.229381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:21.230351 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:21.238636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:21.239352 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:21.240158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:21.241570 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:21.306917 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a5cf869a-0a49-4a75-a6be-442a4bd5e292 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:21.316400 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a5cf869a-0a49-4a75-a6be-442a4bd5e292 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.184157 Jun 21 16:49:21.316995 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 59/106] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:21 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:21.426644 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:21.437687 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:21.440648 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:21.442057 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c305e584-ebdb-4d5e-95e9-749cc30e2de7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.217359 Jun 21 16:49:21.453255 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 48/107] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:21 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:49:21.804658 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-113a19c4-4c67-4b36-b52b-1c8412786c66 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:21.805219 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-113a19c4-4c67-4b36-b52b-1c8412786c66 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:21.816849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f204561e-195c-4db1-b461-d85bf295249b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:21.818271 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f204561e-195c-4db1-b461-d85bf295249b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:21.818814 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-113a19c4-4c67-4b36-b52b-1c8412786c66 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:21.819598 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-113a19c4-4c67-4b36-b52b-1c8412786c66 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:21.821659 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-113a19c4-4c67-4b36-b52b-1c8412786c66 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:21.822299 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-113a19c4-4c67-4b36-b52b-1c8412786c66 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:21.825188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f204561e-195c-4db1-b461-d85bf295249b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:21.839048 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f204561e-195c-4db1-b461-d85bf295249b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:21.839048 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f204561e-195c-4db1-b461-d85bf295249b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:21.839048 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f204561e-195c-4db1-b461-d85bf295249b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:22.000929 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-113a19c4-4c67-4b36-b52b-1c8412786c66 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:22.014273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-113a19c4-4c67-4b36-b52b-1c8412786c66 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.213681 Jun 21 16:49:22.015280 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 60/108] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:21 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:22.047695 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f204561e-195c-4db1-b461-d85bf295249b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:22.057123 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f204561e-195c-4db1-b461-d85bf295249b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.245088 Jun 21 16:49:22.057992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 49/109] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:21 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:22.334668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f8993f99-68ae-405a-9923-9427037fa304 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:22.335193 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f8993f99-68ae-405a-9923-9427037fa304 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:22.341741 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8993f99-68ae-405a-9923-9427037fa304 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:22.342187 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8993f99-68ae-405a-9923-9427037fa304 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:22.342945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8993f99-68ae-405a-9923-9427037fa304 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:22.343376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8993f99-68ae-405a-9923-9427037fa304 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:22.465605 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:22.466481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:22.474227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:22.474681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:22.475454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:22.478707 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f8993f99-68ae-405a-9923-9427037fa304 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:22.482319 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:22.488450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f8993f99-68ae-405a-9923-9427037fa304 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.157646 Jun 21 16:49:22.489228 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 61/110] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:22 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:22.625784 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:22.635156 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:22.636721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:22.637846 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-30168038-891c-4e9c-82f2-aec5a56bfff5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.180561 Jun 21 16:49:22.638402 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 50/111] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:22 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:23.033758 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e3160142-e199-43c5-9e78-bd1dfd746f48 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:23.034944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e3160142-e199-43c5-9e78-bd1dfd746f48 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:23.041505 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e3160142-e199-43c5-9e78-bd1dfd746f48 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:23.042074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e3160142-e199-43c5-9e78-bd1dfd746f48 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:23.042848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e3160142-e199-43c5-9e78-bd1dfd746f48 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:23.043416 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e3160142-e199-43c5-9e78-bd1dfd746f48 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:23.075854 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-11725eb2-10a0-4992-903b-93216e1effca tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:23.077335 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-11725eb2-10a0-4992-903b-93216e1effca tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:23.085341 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-11725eb2-10a0-4992-903b-93216e1effca tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:23.086012 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-11725eb2-10a0-4992-903b-93216e1effca tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:23.086965 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-11725eb2-10a0-4992-903b-93216e1effca tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:23.087596 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-11725eb2-10a0-4992-903b-93216e1effca tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:23.202402 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e3160142-e199-43c5-9e78-bd1dfd746f48 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:23.212207 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e3160142-e199-43c5-9e78-bd1dfd746f48 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.183932 Jun 21 16:49:23.212986 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 62/112] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:23 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:23.240438 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-11725eb2-10a0-4992-903b-93216e1effca tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:23.247725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-11725eb2-10a0-4992-903b-93216e1effca tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.177531 Jun 21 16:49:23.248285 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 51/113] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:23 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:23.509160 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a3c5788b-d888-4a05-8df1-ef8e2a4aaa38 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:23.511124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a3c5788b-d888-4a05-8df1-ef8e2a4aaa38 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:23.517791 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a3c5788b-d888-4a05-8df1-ef8e2a4aaa38 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:23.518405 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a3c5788b-d888-4a05-8df1-ef8e2a4aaa38 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:23.519440 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a3c5788b-d888-4a05-8df1-ef8e2a4aaa38 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:23.519885 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a3c5788b-d888-4a05-8df1-ef8e2a4aaa38 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:23.656956 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:23.659523 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:23.663567 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a3c5788b-d888-4a05-8df1-ef8e2a4aaa38 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:23.664835 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:23.665305 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:23.666069 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:23.666591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:23.671468 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a3c5788b-d888-4a05-8df1-ef8e2a4aaa38 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1314 microversion: 2.1 time: 0.169367 Jun 21 16:49:23.672042 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 63/114] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:23 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:23.822158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:23.830307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:23.832105 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:23.833292 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f7b38bb5-3481-4a4a-a8c6-cc9daeaa012c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.180196 Jun 21 16:49:23.833923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 52/115] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:23 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:49:24.157434 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-67b7516b-6aa7-48ad-a514-f3a779b470ed req-72ecdbe7-2dd7-4bc6-876b-4ff46b8a089d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9af742-a7f3-4113-8ace-571502dad309", "name": "network-vif-plugged", "status": "completed", "tag": "7b305906-1977-410d-88f8-b281cb089050"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:24.167891 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-67b7516b-6aa7-48ad-a514-f3a779b470ed req-72ecdbe7-2dd7-4bc6-876b-4ff46b8a089d service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:24.168452 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-67b7516b-6aa7-48ad-a514-f3a779b470ed req-72ecdbe7-2dd7-4bc6-876b-4ff46b8a089d service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:24.180336 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-67b7516b-6aa7-48ad-a514-f3a779b470ed req-72ecdbe7-2dd7-4bc6-876b-4ff46b8a089d service nova] Creating event network-vif-plugged:7b305906-1977-410d-88f8-b281cb089050 for instance 0d9af742-a7f3-4113-8ace-571502dad309 on hv-cinder-79987 Jun 21 16:49:24.185757 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-67b7516b-6aa7-48ad-a514-f3a779b470ed req-72ecdbe7-2dd7-4bc6-876b-4ff46b8a089d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031906 Jun 21 16:49:24.186608 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 64/116] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:49:24.239513 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0d268204-0168-4241-be32-afca24a844d5 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:24.240112 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0d268204-0168-4241-be32-afca24a844d5 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:24.247218 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0d268204-0168-4241-be32-afca24a844d5 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:24.247665 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0d268204-0168-4241-be32-afca24a844d5 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:24.248427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0d268204-0168-4241-be32-afca24a844d5 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:24.248852 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0d268204-0168-4241-be32-afca24a844d5 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:24.298964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7b7a1141-4272-4800-8b18-f381e84ad43c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:24.299739 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7b7a1141-4272-4800-8b18-f381e84ad43c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:24.313312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7b7a1141-4272-4800-8b18-f381e84ad43c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:24.313766 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7b7a1141-4272-4800-8b18-f381e84ad43c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:24.314539 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7b7a1141-4272-4800-8b18-f381e84ad43c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:24.314974 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7b7a1141-4272-4800-8b18-f381e84ad43c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:24.319966 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=100 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:24.478767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0d268204-0168-4241-be32-afca24a844d5 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:24.488289 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0d268204-0168-4241-be32-afca24a844d5 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.253738 Jun 21 16:49:24.489180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 53/117] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:24 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:24.570611 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7b7a1141-4272-4800-8b18-f381e84ad43c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:24.591938 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7b7a1141-4272-4800-8b18-f381e84ad43c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.300731 Jun 21 16:49:24.591938 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 65/118] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:24 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:24.688319 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0d941338-c878-4964-91d1-0677a5c39de5 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:24.689049 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0d941338-c878-4964-91d1-0677a5c39de5 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:24.697698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0d941338-c878-4964-91d1-0677a5c39de5 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:24.698150 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0d941338-c878-4964-91d1-0677a5c39de5 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:24.698986 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0d941338-c878-4964-91d1-0677a5c39de5 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:24.699352 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0d941338-c878-4964-91d1-0677a5c39de5 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:24.852531 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:24.853138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:24.859947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:24.860601 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:24.861392 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:24.862005 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:24.865175 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0d941338-c878-4964-91d1-0677a5c39de5 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:24.873516 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0d941338-c878-4964-91d1-0677a5c39de5 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1500 microversion: 2.1 time: 0.188667 Jun 21 16:49:24.874982 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 54/119] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:24 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1500 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:25.025221 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:25.033648 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:25.036841 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:25.038081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-88296d34-43a0-486e-ac8b-bcd59dfcc0cc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.189396 Jun 21 16:49:25.038895 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 66/120] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:24 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:49:25.508551 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2a621624-7d4a-42cc-9edd-de44125d89ca tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:25.509906 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2a621624-7d4a-42cc-9edd-de44125d89ca tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:25.517057 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2a621624-7d4a-42cc-9edd-de44125d89ca tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:25.517583 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2a621624-7d4a-42cc-9edd-de44125d89ca tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:25.518523 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2a621624-7d4a-42cc-9edd-de44125d89ca tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:25.519969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2a621624-7d4a-42cc-9edd-de44125d89ca tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:25.607325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ad3a5284-27c4-4f4c-8bbc-0994c84a56d2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:25.608074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ad3a5284-27c4-4f4c-8bbc-0994c84a56d2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:25.615021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ad3a5284-27c4-4f4c-8bbc-0994c84a56d2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:25.615554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ad3a5284-27c4-4f4c-8bbc-0994c84a56d2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:25.616414 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ad3a5284-27c4-4f4c-8bbc-0994c84a56d2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:25.616943 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ad3a5284-27c4-4f4c-8bbc-0994c84a56d2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:25.759926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2a621624-7d4a-42cc-9edd-de44125d89ca tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:25.772758 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2a621624-7d4a-42cc-9edd-de44125d89ca tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.265764 Jun 21 16:49:25.773886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 55/121] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:25 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:25.809484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ad3a5284-27c4-4f4c-8bbc-0994c84a56d2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:25.818642 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ad3a5284-27c4-4f4c-8bbc-0994c84a56d2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.216192 Jun 21 16:49:25.825747 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 67/122] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:25 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:26.056951 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:26.057768 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:26.064059 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:26.064741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:26.066396 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:26.067087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:26.200950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-fa1fabe0-8feb-48c2-af83-06c9aea58d73 req-b8a35554-ecec-4901-97b8-647c1574dbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f605003b-48fd-4e3f-9f19-462e7b713558", "name": "network-vif-plugged", "status": "completed", "tag": "a340b6f8-fea6-4847-a4cd-7d1ef896ed71"}, {"server_uuid": "f3358207-e4db-4c88-b56b-05f718c39a8e", "name": "network-vif-plugged", "status": "completed", "tag": "1382e7bf-7f7f-4cf3-a568-1e6303eb5b15"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:26.210876 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-fa1fabe0-8feb-48c2-af83-06c9aea58d73 req-b8a35554-ecec-4901-97b8-647c1574dbed service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:26.211729 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-fa1fabe0-8feb-48c2-af83-06c9aea58d73 req-b8a35554-ecec-4901-97b8-647c1574dbed service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:26.225123 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:26.235548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-fa1fabe0-8feb-48c2-af83-06c9aea58d73 req-b8a35554-ecec-4901-97b8-647c1574dbed service nova] Creating event network-vif-plugged:a340b6f8-fea6-4847-a4cd-7d1ef896ed71 for instance f605003b-48fd-4e3f-9f19-462e7b713558 on hv-cinder-79987 Jun 21 16:49:26.236013 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-fa1fabe0-8feb-48c2-af83-06c9aea58d73 req-b8a35554-ecec-4901-97b8-647c1574dbed service nova] Creating event network-vif-plugged:1382e7bf-7f7f-4cf3-a568-1e6303eb5b15 for instance f3358207-e4db-4c88-b56b-05f718c39a8e on hv-cinder-79987 Jun 21 16:49:26.237364 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:26.239989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:26.241392 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a7353dc0-b52c-4e98-97ec-bc83aa8ae550 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1407 microversion: 2.20 time: 0.189071 Jun 21 16:49:26.242137 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 56/123] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:26 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:49:26.244368 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-fa1fabe0-8feb-48c2-af83-06c9aea58d73 req-b8a35554-ecec-4901-97b8-647c1574dbed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047432 Jun 21 16:49:26.247738 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 68/124] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:49:26.801369 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5a8d7c64-5eab-4b11-8644-6916efa57be3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:26.802903 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5a8d7c64-5eab-4b11-8644-6916efa57be3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:26.817727 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a8d7c64-5eab-4b11-8644-6916efa57be3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:26.819375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a8d7c64-5eab-4b11-8644-6916efa57be3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:26.820869 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a8d7c64-5eab-4b11-8644-6916efa57be3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:26.821267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4e1b442b-8fc9-4584-9eda-064e4f3b7343 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85b56cc3-dc50-4abe-b6ea-bba8ac9a2909"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:26.822332 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a8d7c64-5eab-4b11-8644-6916efa57be3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:26.828353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4e1b442b-8fc9-4584-9eda-064e4f3b7343 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:26.832068 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4e1b442b-8fc9-4584-9eda-064e4f3b7343 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:26.832518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4e1b442b-8fc9-4584-9eda-064e4f3b7343 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:26.837517 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4e1b442b-8fc9-4584-9eda-064e4f3b7343 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:26.838157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4e1b442b-8fc9-4584-9eda-064e4f3b7343 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:26.975908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5a8d7c64-5eab-4b11-8644-6916efa57be3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:26.991635 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5a8d7c64-5eab-4b11-8644-6916efa57be3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.204654 Jun 21 16:49:26.992487 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 57/125] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:26 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:27.005760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1b8f1db0-96b4-43f9-9a9b-42583bc9af70 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:27.006391 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1b8f1db0-96b4-43f9-9a9b-42583bc9af70 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:27.015780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b8f1db0-96b4-43f9-9a9b-42583bc9af70 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:27.015780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b8f1db0-96b4-43f9-9a9b-42583bc9af70 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:27.015780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b8f1db0-96b4-43f9-9a9b-42583bc9af70 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:27.016236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b8f1db0-96b4-43f9-9a9b-42583bc9af70 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:27.396169 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1b8f1db0-96b4-43f9-9a9b-42583bc9af70 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:27.407108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1b8f1db0-96b4-43f9-9a9b-42583bc9af70 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.413340 Jun 21 16:49:27.417494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 58/126] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:26 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:27.422347 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:27.422948 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:27.429753 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:27.430265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:27.431111 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:27.431602 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:27.607764 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:27.618088 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:27.619753 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:27.620932 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-da6578c2-ffab-4a87-8c23-9c895314892c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1599 microversion: 2.20 time: 0.202420 Jun 21 16:49:27.621523 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 59/127] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:49:27 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1599 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:49:27.639454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2976c341-fb3a-48e9-8db3-b800ceea25a4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:27.640097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2976c341-fb3a-48e9-8db3-b800ceea25a4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:27.646915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2976c341-fb3a-48e9-8db3-b800ceea25a4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:27.647569 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2976c341-fb3a-48e9-8db3-b800ceea25a4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:27.648739 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2976c341-fb3a-48e9-8db3-b800ceea25a4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:27.649376 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2976c341-fb3a-48e9-8db3-b800ceea25a4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:27.685427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=100 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:27.786755 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2976c341-fb3a-48e9-8db3-b800ceea25a4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151022 Jun 21 16:49:27.787381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 60/128] 10.222.0.70 () {60 vars in 1315 bytes} [Tue Jun 21 16:49:27 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 16:49:27.898385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4e1b442b-8fc9-4584-9eda-064e4f3b7343 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "POST /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081780 Jun 21 16:49:27.908885 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 69/129] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:49:26 2022] POST /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d/os-volume_attachments => generated 194 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:49:28.008469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-24292d1f-6181-4959-acc1-d8acab3dab3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:28.009673 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-24292d1f-6181-4959-acc1-d8acab3dab3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:28.016382 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-24292d1f-6181-4959-acc1-d8acab3dab3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:28.017345 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-24292d1f-6181-4959-acc1-d8acab3dab3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:28.018298 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-24292d1f-6181-4959-acc1-d8acab3dab3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:28.019574 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-24292d1f-6181-4959-acc1-d8acab3dab3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:28.380567 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-24292d1f-6181-4959-acc1-d8acab3dab3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:28.391217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-24292d1f-6181-4959-acc1-d8acab3dab3e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1363 microversion: 2.1 time: 0.386967 Jun 21 16:49:28.391798 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 61/130] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:28 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:28.426417 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8bbac873-520e-400f-b6be-9b32bbbc658b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:28.427104 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8bbac873-520e-400f-b6be-9b32bbbc658b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:28.435977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8bbac873-520e-400f-b6be-9b32bbbc658b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:28.442074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8bbac873-520e-400f-b6be-9b32bbbc658b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:28.442074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8bbac873-520e-400f-b6be-9b32bbbc658b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:28.442074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8bbac873-520e-400f-b6be-9b32bbbc658b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:28.621903 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8bbac873-520e-400f-b6be-9b32bbbc658b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:28.630877 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8bbac873-520e-400f-b6be-9b32bbbc658b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1322 microversion: 2.1 time: 0.210608 Jun 21 16:49:28.631465 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 70/131] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:28 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:29.416146 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fdc9bd36-883d-4d75-98a2-256c12cdbfbd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:29.417453 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-fdc9bd36-883d-4d75-98a2-256c12cdbfbd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:29.426153 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fdc9bd36-883d-4d75-98a2-256c12cdbfbd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:29.426886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fdc9bd36-883d-4d75-98a2-256c12cdbfbd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:29.429251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fdc9bd36-883d-4d75-98a2-256c12cdbfbd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:29.430045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fdc9bd36-883d-4d75-98a2-256c12cdbfbd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:29.649104 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-320703c9-350c-4086-a75b-0190452e252e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:29.649742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-320703c9-350c-4086-a75b-0190452e252e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:29.661106 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-320703c9-350c-4086-a75b-0190452e252e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:29.662943 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-320703c9-350c-4086-a75b-0190452e252e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:29.665212 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-320703c9-350c-4086-a75b-0190452e252e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:29.665700 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-320703c9-350c-4086-a75b-0190452e252e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:29.787003 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fdc9bd36-883d-4d75-98a2-256c12cdbfbd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:29.800693 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fdc9bd36-883d-4d75-98a2-256c12cdbfbd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1549 microversion: 2.1 time: 0.391541 Jun 21 16:49:29.805394 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 62/132] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:29 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1549 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:29.813741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-323cafce-3815-449b-8ba8-082fa994c769 req-521d30f2-549b-4faf-9b1d-e62667725ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9af742-a7f3-4113-8ace-571502dad309", "tag": "7b305906-1977-410d-88f8-b281cb089050"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:29.824419 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-323cafce-3815-449b-8ba8-082fa994c769 req-521d30f2-549b-4faf-9b1d-e62667725ed1 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:29.828625 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-323cafce-3815-449b-8ba8-082fa994c769 req-521d30f2-549b-4faf-9b1d-e62667725ed1 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:29.856682 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-323cafce-3815-449b-8ba8-082fa994c769 req-521d30f2-549b-4faf-9b1d-e62667725ed1 service nova] Creating event network-changed:7b305906-1977-410d-88f8-b281cb089050 for instance 0d9af742-a7f3-4113-8ace-571502dad309 on hv-cinder-79987 Jun 21 16:49:29.871605 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-323cafce-3815-449b-8ba8-082fa994c769 req-521d30f2-549b-4faf-9b1d-e62667725ed1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061727 Jun 21 16:49:29.872271 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 63/133] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:49:29.895306 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-96e0c323-7ff2-4222-94be-f21e02ca0f07 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:29.895927 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-96e0c323-7ff2-4222-94be-f21e02ca0f07 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:29.924487 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-96e0c323-7ff2-4222-94be-f21e02ca0f07 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:29.924945 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-96e0c323-7ff2-4222-94be-f21e02ca0f07 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:29.931931 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-96e0c323-7ff2-4222-94be-f21e02ca0f07 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:29.934275 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-96e0c323-7ff2-4222-94be-f21e02ca0f07 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:29.952687 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-320703c9-350c-4086-a75b-0190452e252e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:29.966451 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-320703c9-350c-4086-a75b-0190452e252e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1516 microversion: 2.1 time: 0.321871 Jun 21 16:49:29.967115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 71/134] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:29 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1516 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:30.005535 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6f253a94-33bb-43b0-b9f8-ca290f79f522 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:30.006596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6f253a94-33bb-43b0-b9f8-ca290f79f522 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:30.037179 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6f253a94-33bb-43b0-b9f8-ca290f79f522 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:30.039600 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6f253a94-33bb-43b0-b9f8-ca290f79f522 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:30.041993 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6f253a94-33bb-43b0-b9f8-ca290f79f522 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:30.042309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6f253a94-33bb-43b0-b9f8-ca290f79f522 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:30.117026 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-6f253a94-33bb-43b0-b9f8-ca290f79f522 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lazy-loading 'flavor' on Instance uuid f3358207-e4db-4c88-b56b-05f718c39a8e {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:49:30.364172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-96e0c323-7ff2-4222-94be-f21e02ca0f07 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.472838 Jun 21 16:49:30.364954 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 64/135] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 16:49:29 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/os-interface => generated 284 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:49:30.515668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6f253a94-33bb-43b0-b9f8-ca290f79f522 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e/action" status: 200 len: 32 microversion: 2.1 time: 0.516911 Jun 21 16:49:30.516377 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 72/136] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:49:29 2022] POST /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e/action => generated 32 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:49:30.527374 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-419cc713-a6eb-4641-86f6-a19c212c75fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:30.527975 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-419cc713-a6eb-4641-86f6-a19c212c75fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:30.538934 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-419cc713-a6eb-4641-86f6-a19c212c75fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:30.539363 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-419cc713-a6eb-4641-86f6-a19c212c75fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:30.540129 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-419cc713-a6eb-4641-86f6-a19c212c75fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:30.540554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-419cc713-a6eb-4641-86f6-a19c212c75fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:31.098524 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-419cc713-a6eb-4641-86f6-a19c212c75fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:31.117796 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-419cc713-a6eb-4641-86f6-a19c212c75fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.594201 Jun 21 16:49:31.119880 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 65/137] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:30 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:32.136682 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-107dc5db-54ea-48d9-9504-07dba36c80a0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:32.137407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-107dc5db-54ea-48d9-9504-07dba36c80a0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:32.148328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-107dc5db-54ea-48d9-9504-07dba36c80a0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:32.149069 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-107dc5db-54ea-48d9-9504-07dba36c80a0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:32.149870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-107dc5db-54ea-48d9-9504-07dba36c80a0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:32.150444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-107dc5db-54ea-48d9-9504-07dba36c80a0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:32.336354 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-a030c938-8a39-4d00-b5eb-12d04efa2e7f req-456a9035-5c5b-4b64-96df-aa65d39070fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f605003b-48fd-4e3f-9f19-462e7b713558", "tag": "a340b6f8-fea6-4847-a4cd-7d1ef896ed71"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:32.364777 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-a030c938-8a39-4d00-b5eb-12d04efa2e7f req-456a9035-5c5b-4b64-96df-aa65d39070fd service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:32.365361 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-a030c938-8a39-4d00-b5eb-12d04efa2e7f req-456a9035-5c5b-4b64-96df-aa65d39070fd service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:32.420353 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-a030c938-8a39-4d00-b5eb-12d04efa2e7f req-456a9035-5c5b-4b64-96df-aa65d39070fd service nova] Creating event network-changed:a340b6f8-fea6-4847-a4cd-7d1ef896ed71 for instance f605003b-48fd-4e3f-9f19-462e7b713558 on hv-cinder-79987 Jun 21 16:49:32.426413 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-a030c938-8a39-4d00-b5eb-12d04efa2e7f req-456a9035-5c5b-4b64-96df-aa65d39070fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094512 Jun 21 16:49:32.427334 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 66/138] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:49:32.484577 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-107dc5db-54ea-48d9-9504-07dba36c80a0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:32.496963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-107dc5db-54ea-48d9-9504-07dba36c80a0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.364614 Jun 21 16:49:32.498686 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 73/139] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:32 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:33.516407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0507e81b-5c23-40d2-bcc8-fd32c9b0f2a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:33.517212 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0507e81b-5c23-40d2-bcc8-fd32c9b0f2a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:33.526857 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0507e81b-5c23-40d2-bcc8-fd32c9b0f2a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:33.527403 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0507e81b-5c23-40d2-bcc8-fd32c9b0f2a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:33.528500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0507e81b-5c23-40d2-bcc8-fd32c9b0f2a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:33.528941 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0507e81b-5c23-40d2-bcc8-fd32c9b0f2a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:33.688941 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0507e81b-5c23-40d2-bcc8-fd32c9b0f2a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:33.697593 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0507e81b-5c23-40d2-bcc8-fd32c9b0f2a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.185649 Jun 21 16:49:33.698573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 67/140] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:33 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:34.714413 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f8fc5efa-a9e3-485c-87d8-d6b10b960f8c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:34.715694 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f8fc5efa-a9e3-485c-87d8-d6b10b960f8c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:34.718583 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=95 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:34.725463 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8fc5efa-a9e3-485c-87d8-d6b10b960f8c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:34.725977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8fc5efa-a9e3-485c-87d8-d6b10b960f8c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:34.726838 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8fc5efa-a9e3-485c-87d8-d6b10b960f8c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:34.727349 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8fc5efa-a9e3-485c-87d8-d6b10b960f8c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:34.871592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f8fc5efa-a9e3-485c-87d8-d6b10b960f8c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:34.879249 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f8fc5efa-a9e3-485c-87d8-d6b10b960f8c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.168724 Jun 21 16:49:34.880548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 74/141] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:34 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:35.896857 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f10e7808-deb7-495a-80c5-c8dbf6681f7e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:35.897695 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f10e7808-deb7-495a-80c5-c8dbf6681f7e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:35.905506 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f10e7808-deb7-495a-80c5-c8dbf6681f7e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:35.906062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f10e7808-deb7-495a-80c5-c8dbf6681f7e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:35.907539 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f10e7808-deb7-495a-80c5-c8dbf6681f7e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:35.907539 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f10e7808-deb7-495a-80c5-c8dbf6681f7e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:36.050295 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f10e7808-deb7-495a-80c5-c8dbf6681f7e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:36.059951 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f10e7808-deb7-495a-80c5-c8dbf6681f7e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.165545 Jun 21 16:49:36.059951 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 68/142] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:35 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:37.076167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d74fd5ae-ec45-4e8c-bb3a-7ead84349907 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:37.076769 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d74fd5ae-ec45-4e8c-bb3a-7ead84349907 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:37.084120 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d74fd5ae-ec45-4e8c-bb3a-7ead84349907 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:37.084568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d74fd5ae-ec45-4e8c-bb3a-7ead84349907 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:37.085363 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d74fd5ae-ec45-4e8c-bb3a-7ead84349907 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:37.085805 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d74fd5ae-ec45-4e8c-bb3a-7ead84349907 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:37.219748 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d74fd5ae-ec45-4e8c-bb3a-7ead84349907 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:37.228463 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d74fd5ae-ec45-4e8c-bb3a-7ead84349907 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.156187 Jun 21 16:49:37.229060 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 75/143] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:37 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:38.246384 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-26bee404-f299-483d-8a41-f95b68996689 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:38.246995 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-26bee404-f299-483d-8a41-f95b68996689 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:38.249078 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=94 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:38.254445 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26bee404-f299-483d-8a41-f95b68996689 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:38.254889 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26bee404-f299-483d-8a41-f95b68996689 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:38.256303 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26bee404-f299-483d-8a41-f95b68996689 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:38.256807 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26bee404-f299-483d-8a41-f95b68996689 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:38.396429 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-26bee404-f299-483d-8a41-f95b68996689 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:38.404481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-26bee404-f299-483d-8a41-f95b68996689 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.161935 Jun 21 16:49:38.405054 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 69/144] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:38 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:39.421904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a751be33-5fb5-4de9-a1d1-7ec7e4a84951 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:39.422724 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a751be33-5fb5-4de9-a1d1-7ec7e4a84951 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:39.429793 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a751be33-5fb5-4de9-a1d1-7ec7e4a84951 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:39.430233 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a751be33-5fb5-4de9-a1d1-7ec7e4a84951 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:39.431009 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a751be33-5fb5-4de9-a1d1-7ec7e4a84951 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:39.431448 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a751be33-5fb5-4de9-a1d1-7ec7e4a84951 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:39.580447 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a751be33-5fb5-4de9-a1d1-7ec7e4a84951 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:39.589560 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a751be33-5fb5-4de9-a1d1-7ec7e4a84951 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.171397 Jun 21 16:49:39.590344 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 76/145] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:39 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:40.611035 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5e527c61-5e9b-42f7-b471-9951e4544175 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:40.611918 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5e527c61-5e9b-42f7-b471-9951e4544175 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:40.619368 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e527c61-5e9b-42f7-b471-9951e4544175 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:40.619837 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e527c61-5e9b-42f7-b471-9951e4544175 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:40.620801 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e527c61-5e9b-42f7-b471-9951e4544175 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:40.621421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e527c61-5e9b-42f7-b471-9951e4544175 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:41.017421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5e527c61-5e9b-42f7-b471-9951e4544175 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:41.029391 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5e527c61-5e9b-42f7-b471-9951e4544175 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.423152 Jun 21 16:49:41.030002 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 70/146] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:40 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:42.047694 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-882e6010-0aff-4e93-a822-578f12cb1696 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:42.048417 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-882e6010-0aff-4e93-a822-578f12cb1696 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:42.055124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-882e6010-0aff-4e93-a822-578f12cb1696 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:42.055577 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-882e6010-0aff-4e93-a822-578f12cb1696 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:42.056342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-882e6010-0aff-4e93-a822-578f12cb1696 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:42.056775 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-882e6010-0aff-4e93-a822-578f12cb1696 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:42.195432 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-882e6010-0aff-4e93-a822-578f12cb1696 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:42.204742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-882e6010-0aff-4e93-a822-578f12cb1696 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.161276 Jun 21 16:49:42.205623 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 77/147] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:42 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:42.378136 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5e52723e-8121-438b-9b8a-ab6d977c6856 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:42.378936 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5e52723e-8121-438b-9b8a-ab6d977c6856 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:42.391345 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e52723e-8121-438b-9b8a-ab6d977c6856 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:42.391908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e52723e-8121-438b-9b8a-ab6d977c6856 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:42.392767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e52723e-8121-438b-9b8a-ab6d977c6856 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:42.393256 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e52723e-8121-438b-9b8a-ab6d977c6856 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:42.419870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5e52723e-8121-438b-9b8a-ab6d977c6856 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:49:42.770094 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5e52723e-8121-438b-9b8a-ab6d977c6856 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 204 len: 0 microversion: 2.1 time: 0.399462 Jun 21 16:49:42.770693 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 71/148] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:49:42 2022] DELETE /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 16:49:42.786717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1753aef9-60af-4911-b4bd-dda3620f3275 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:42.787310 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1753aef9-60af-4911-b4bd-dda3620f3275 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:42.794405 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1753aef9-60af-4911-b4bd-dda3620f3275 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:42.795132 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1753aef9-60af-4911-b4bd-dda3620f3275 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:42.796226 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1753aef9-60af-4911-b4bd-dda3620f3275 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:42.796657 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1753aef9-60af-4911-b4bd-dda3620f3275 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:42.942028 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1753aef9-60af-4911-b4bd-dda3620f3275 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:42.951187 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1753aef9-60af-4911-b4bd-dda3620f3275 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1552 microversion: 2.1 time: 0.168647 Jun 21 16:49:42.951752 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 78/149] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:42 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:49:43.224301 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d64e0f66-e3f4-432b-960c-cf7b65ba764d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:43.225024 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d64e0f66-e3f4-432b-960c-cf7b65ba764d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:43.232249 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d64e0f66-e3f4-432b-960c-cf7b65ba764d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:43.232249 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d64e0f66-e3f4-432b-960c-cf7b65ba764d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:43.232947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d64e0f66-e3f4-432b-960c-cf7b65ba764d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:43.233440 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d64e0f66-e3f4-432b-960c-cf7b65ba764d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:43.381614 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d64e0f66-e3f4-432b-960c-cf7b65ba764d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:43.389326 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d64e0f66-e3f4-432b-960c-cf7b65ba764d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.169593 Jun 21 16:49:43.389904 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 72/150] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:43 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:43.968490 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-adf54753-dc56-430b-811b-cf0b241886ce tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:43.969110 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-adf54753-dc56-430b-811b-cf0b241886ce tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:43.976369 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-adf54753-dc56-430b-811b-cf0b241886ce tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:43.976813 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-adf54753-dc56-430b-811b-cf0b241886ce tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:43.977591 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-adf54753-dc56-430b-811b-cf0b241886ce tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:43.978014 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-adf54753-dc56-430b-811b-cf0b241886ce tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:43.981860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:44.112655 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-adf54753-dc56-430b-811b-cf0b241886ce tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:44.120615 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-adf54753-dc56-430b-811b-cf0b241886ce tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1552 microversion: 2.1 time: 0.155975 Jun 21 16:49:44.121184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 79/151] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:43 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:44.407707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ce7d4dba-c9b6-413d-867c-edccc25c1478 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:44.409936 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ce7d4dba-c9b6-413d-867c-edccc25c1478 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:44.417064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ce7d4dba-c9b6-413d-867c-edccc25c1478 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:44.417547 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ce7d4dba-c9b6-413d-867c-edccc25c1478 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:44.418313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ce7d4dba-c9b6-413d-867c-edccc25c1478 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:44.418753 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ce7d4dba-c9b6-413d-867c-edccc25c1478 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:44.573320 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ce7d4dba-c9b6-413d-867c-edccc25c1478 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:44.580878 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ce7d4dba-c9b6-413d-867c-edccc25c1478 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.177502 Jun 21 16:49:44.588180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 73/152] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:44 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:45.138340 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8fd5a543-6f9e-493b-8e6c-c115872ee048 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:45.139087 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8fd5a543-6f9e-493b-8e6c-c115872ee048 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:45.146341 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8fd5a543-6f9e-493b-8e6c-c115872ee048 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:45.147104 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8fd5a543-6f9e-493b-8e6c-c115872ee048 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:45.148068 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8fd5a543-6f9e-493b-8e6c-c115872ee048 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:45.148655 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8fd5a543-6f9e-493b-8e6c-c115872ee048 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:45.298165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8fd5a543-6f9e-493b-8e6c-c115872ee048 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:45.307083 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8fd5a543-6f9e-493b-8e6c-c115872ee048 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1552 microversion: 2.1 time: 0.173181 Jun 21 16:49:45.316694 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 80/153] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:45 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:45.598807 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-46376e1b-375e-491c-829e-4af335483f36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:45.599408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-46376e1b-375e-491c-829e-4af335483f36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:45.607112 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-46376e1b-375e-491c-829e-4af335483f36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:45.607551 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-46376e1b-375e-491c-829e-4af335483f36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:45.608941 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-46376e1b-375e-491c-829e-4af335483f36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:45.609558 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-46376e1b-375e-491c-829e-4af335483f36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:45.878586 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-46376e1b-375e-491c-829e-4af335483f36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:45.888691 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-46376e1b-375e-491c-829e-4af335483f36 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.293523 Jun 21 16:49:45.890690 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 74/154] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:45 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:46.233568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-76a5a97a-a62c-4397-ab8d-d310177763d8 req-7c657bb3-f264-4af6-9073-28153163ea30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d316a40-ffbf-47fa-83b7-58afe1fc093d", "name": "network-vif-deleted", "tag": "6016e0b6-cbeb-464d-bd9e-9bd83c250e62"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:46.247461 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-76a5a97a-a62c-4397-ab8d-d310177763d8 req-7c657bb3-f264-4af6-9073-28153163ea30 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:46.248971 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-76a5a97a-a62c-4397-ab8d-d310177763d8 req-7c657bb3-f264-4af6-9073-28153163ea30 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:46.261198 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-76a5a97a-a62c-4397-ab8d-d310177763d8 req-7c657bb3-f264-4af6-9073-28153163ea30 service nova] Creating event network-vif-deleted:6016e0b6-cbeb-464d-bd9e-9bd83c250e62 for instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d on hv-cinder-79987 Jun 21 16:49:46.267523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-76a5a97a-a62c-4397-ab8d-d310177763d8 req-7c657bb3-f264-4af6-9073-28153163ea30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037395 Jun 21 16:49:46.268483 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 81/155] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:49:46.326036 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-68776cde-311d-4fa8-97a4-22d24d4f9164 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:46.327024 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-68776cde-311d-4fa8-97a4-22d24d4f9164 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:46.339694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-68776cde-311d-4fa8-97a4-22d24d4f9164 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:46.340400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-68776cde-311d-4fa8-97a4-22d24d4f9164 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:46.341183 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-68776cde-311d-4fa8-97a4-22d24d4f9164 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:46.341967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-68776cde-311d-4fa8-97a4-22d24d4f9164 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:46.412446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-68776cde-311d-4fa8-97a4-22d24d4f9164 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:46.421313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-68776cde-311d-4fa8-97a4-22d24d4f9164 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1510 microversion: 2.1 time: 0.100558 Jun 21 16:49:46.422093 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 75/156] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:46 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:46.909135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d0e3c99a-8785-4348-9bed-cd9a426f1b6b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:46.916107 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d0e3c99a-8785-4348-9bed-cd9a426f1b6b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:46.918733 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d0e3c99a-8785-4348-9bed-cd9a426f1b6b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:46.919244 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d0e3c99a-8785-4348-9bed-cd9a426f1b6b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:46.920068 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d0e3c99a-8785-4348-9bed-cd9a426f1b6b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:46.920561 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d0e3c99a-8785-4348-9bed-cd9a426f1b6b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:47.071020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d0e3c99a-8785-4348-9bed-cd9a426f1b6b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:47.087155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d0e3c99a-8785-4348-9bed-cd9a426f1b6b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.183930 Jun 21 16:49:47.095821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 82/157] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:46 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:47.440262 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:47.440868 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:47.447764 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:47.448199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:47.448944 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:47.449443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:47.486158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:47.486594 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:47.487078 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lazy-loading 'fault' on Instance uuid 2d316a40-ffbf-47fa-83b7-58afe1fc093d {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:49:47.572642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22950ef462df4f54a999200e183200c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d951c7f7afd49b09b6045b09a9d98e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:47.577224 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:49:47.582273 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c85682d4-079d-4a13-9afb-6a9f3333ceda tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 200 len: 1350 microversion: 2.1 time: 0.146302 Jun 21 16:49:47.586427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 76/158] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:47 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:48.105155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c8d5b15d-025d-4c32-9c18-f7a016f5410c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:48.105722 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c8d5b15d-025d-4c32-9c18-f7a016f5410c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:48.112200 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c8d5b15d-025d-4c32-9c18-f7a016f5410c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:48.112631 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c8d5b15d-025d-4c32-9c18-f7a016f5410c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:48.113411 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c8d5b15d-025d-4c32-9c18-f7a016f5410c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:48.113842 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c8d5b15d-025d-4c32-9c18-f7a016f5410c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:48.287705 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c8d5b15d-025d-4c32-9c18-f7a016f5410c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:48.295892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c8d5b15d-025d-4c32-9c18-f7a016f5410c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.195338 Jun 21 16:49:48.296453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 83/159] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:48 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:48.601478 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:48.602238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:48.616472 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:48.616472 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:48.616472 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:48.616472 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:48.624398 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] HTTP exception thrown: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Request method failure captured: Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d HTTP/1.1 Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZqyNymlHa3g_9aMv-i6lnmSaPh7A1u24pChaJTQfmzobqy6w6rXN8WbHNL7Z4ihVy8avn6oYgl08B1ggPvejY4RmAKkKeDwOinYzfTu2O2b7dvDMzoBfe55ndGZrD7Hqo4IMlruOK1nWLxL1rOwCxMKcSpBNoKsBsM-rlNZAxJZws Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 8d951c7f7afd49b09b6045b09a9d98e0 Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:49:48.629409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8d951c7f7afd49b09b6045b09a9d98e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 8d951c7f7afd49b09b6045b09a9d98e0 Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-DeleteServersTestJSON-565073086-project Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 22950ef462df4f54a999200e183200c3 Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-DeleteServersTestJSON-565073086-project Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.630905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '2d316a40-ffbf-47fa-83b7-58afe1fc093d'} Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:48.631808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.634446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.635731 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Returning 404 to user: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:48.635731 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1c009bed-6e79-44a3-b9f4-584b28ea35c7 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 404 len: 111 microversion: 2.1 time: 0.033352 Jun 21 16:49:48.635731 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 77/160] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:48 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:49:48.753804 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:48.754742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:48.762460 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:48.762868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:48.763679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:48.764113 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:48.778831 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] HTTP exception thrown: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Request method failure captured: Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d/os-volume_attachments HTTP/1.1 Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZqyNymlHa3g_9aMv-i6lnmSaPh7A1u24pChaJTQfmzobqy6w6rXN8WbHNL7Z4ihVy8avn6oYgl08B1ggPvejY4RmAKkKeDwOinYzfTu2O2b7dvDMzoBfe55ndGZrD7Hqo4IMlruOK1nWLxL1rOwCxMKcSpBNoKsBsM-rlNZAxJZws Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 8d951c7f7afd49b09b6045b09a9d98e0 Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:49:48.790764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8d951c7f7afd49b09b6045b09a9d98e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 8d951c7f7afd49b09b6045b09a9d98e0 Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-DeleteServersTestJSON-565073086-project Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 22950ef462df4f54a999200e183200c3 Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-DeleteServersTestJSON-565073086-project Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.792115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'server_id': '2d316a40-ffbf-47fa-83b7-58afe1fc093d'} Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:48.792908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:48.794166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:48.795453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Returning 404 to user: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:48.795453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-edd73076-382d-4b85-bcb2-b9e08059b30f tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042682 Jun 21 16:49:48.795453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 84/161] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:49:48 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:49:49.313803 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b30e7d71-73f1-4aca-856a-1b688728a9f8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:49.314565 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b30e7d71-73f1-4aca-856a-1b688728a9f8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:49.323265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b30e7d71-73f1-4aca-856a-1b688728a9f8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:49.323656 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b30e7d71-73f1-4aca-856a-1b688728a9f8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:49.324438 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b30e7d71-73f1-4aca-856a-1b688728a9f8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:49.324903 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b30e7d71-73f1-4aca-856a-1b688728a9f8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:49.507108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b30e7d71-73f1-4aca-856a-1b688728a9f8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:49.518348 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b30e7d71-73f1-4aca-856a-1b688728a9f8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.208887 Jun 21 16:49:49.518913 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 78/162] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:49 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:50.154629 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:50.155543 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:50.162517 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:50.162963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:50.163727 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:50.165172 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:50.190793 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] HTTP exception thrown: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Request method failure captured: Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: DELETE /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d HTTP/1.1 Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZqyNymlHa3g_9aMv-i6lnmSaPh7A1u24pChaJTQfmzobqy6w6rXN8WbHNL7Z4ihVy8avn6oYgl08B1ggPvejY4RmAKkKeDwOinYzfTu2O2b7dvDMzoBfe55ndGZrD7Hqo4IMlruOK1nWLxL1rOwCxMKcSpBNoKsBsM-rlNZAxJZws Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 8d951c7f7afd49b09b6045b09a9d98e0 Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:49:50.192904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8d951c7f7afd49b09b6045b09a9d98e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 8d951c7f7afd49b09b6045b09a9d98e0 Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-DeleteServersTestJSON-565073086-project Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 22950ef462df4f54a999200e183200c3 Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-DeleteServersTestJSON-565073086-project Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.194293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '2d316a40-ffbf-47fa-83b7-58afe1fc093d'} Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:50.195082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.196527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.197874 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Returning 404 to user: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:50.197874 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6fe6a456-e7d6-44f6-a8a3-cc9a33e0fb42 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 404 len: 111 microversion: 2.1 time: 0.044150 Jun 21 16:49:50.197874 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 85/163] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:49:50 2022] DELETE /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 16:49:50.204193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:50.207834 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] [instance: 2d316a40-ffbf-47fa-83b7-58afe1fc093d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:50.211925 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:50.212379 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:50.213366 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:50.213737 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:50.231640 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] HTTP exception thrown: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Request method failure captured: Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d HTTP/1.1 Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZqyNymlHa3g_9aMv-i6lnmSaPh7A1u24pChaJTQfmzobqy6w6rXN8WbHNL7Z4ihVy8avn6oYgl08B1ggPvejY4RmAKkKeDwOinYzfTu2O2b7dvDMzoBfe55ndGZrD7Hqo4IMlruOK1nWLxL1rOwCxMKcSpBNoKsBsM-rlNZAxJZws Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 8d951c7f7afd49b09b6045b09a9d98e0 Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:49:50.233242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8d951c7f7afd49b09b6045b09a9d98e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8d951c7f7afd49b09b6045b09a9d98e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 8d951c7f7afd49b09b6045b09a9d98e0 Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-DeleteServersTestJSON-565073086 Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-DeleteServersTestJSON-565073086-project Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 22950ef462df4f54a999200e183200c3 Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-DeleteServersTestJSON-565073086-project Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.234884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '2d316a40-ffbf-47fa-83b7-58afe1fc093d'} Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:50.235684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. Jun 21 16:49:50.237225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:50.238421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] Returning 404 to user: Instance 2d316a40-ffbf-47fa-83b7-58afe1fc093d could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:50.238421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-dd5031f7-1449-4b9c-bf32-0a326f47d612 tempest-DeleteServersTestJSON-565073086 tempest-DeleteServersTestJSON-565073086-project] 10.222.0.70 "GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d" status: 404 len: 111 microversion: 2.1 time: 0.037520 Jun 21 16:49:50.239205 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 79/164] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:50 2022] GET /compute/v2.1/servers/2d316a40-ffbf-47fa-83b7-58afe1fc093d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:49:50.541140 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7fa78cdb-118a-4367-a3b8-bfee68c26b27 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:50.542219 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7fa78cdb-118a-4367-a3b8-bfee68c26b27 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:50.562333 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fa78cdb-118a-4367-a3b8-bfee68c26b27 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:50.562869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fa78cdb-118a-4367-a3b8-bfee68c26b27 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:50.568271 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fa78cdb-118a-4367-a3b8-bfee68c26b27 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:50.569005 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fa78cdb-118a-4367-a3b8-bfee68c26b27 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:51.176024 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7fa78cdb-118a-4367-a3b8-bfee68c26b27 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:51.185738 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7fa78cdb-118a-4367-a3b8-bfee68c26b27 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.652549 Jun 21 16:49:51.186309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 86/165] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:50 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:52.205088 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b3c9d689-0798-4641-b5d2-eb72e717edbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:52.206294 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b3c9d689-0798-4641-b5d2-eb72e717edbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:52.213199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3c9d689-0798-4641-b5d2-eb72e717edbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:52.213677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3c9d689-0798-4641-b5d2-eb72e717edbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:52.214656 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3c9d689-0798-4641-b5d2-eb72e717edbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:52.215280 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3c9d689-0798-4641-b5d2-eb72e717edbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:52.374789 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b3c9d689-0798-4641-b5d2-eb72e717edbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:52.382378 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b3c9d689-0798-4641-b5d2-eb72e717edbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.181294 Jun 21 16:49:52.383443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 80/166] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:52 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:53.408036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-dffb17d0-63d4-42cb-93e8-72d0945b5a82 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:53.408642 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-dffb17d0-63d4-42cb-93e8-72d0945b5a82 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:53.424479 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dffb17d0-63d4-42cb-93e8-72d0945b5a82 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:53.426122 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dffb17d0-63d4-42cb-93e8-72d0945b5a82 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:53.428353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dffb17d0-63d4-42cb-93e8-72d0945b5a82 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:53.429816 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dffb17d0-63d4-42cb-93e8-72d0945b5a82 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:53.678396 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-dffb17d0-63d4-42cb-93e8-72d0945b5a82 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:53.688691 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-dffb17d0-63d4-42cb-93e8-72d0945b5a82 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.290066 Jun 21 16:49:53.699981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 87/167] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:53 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:54.713716 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bd0a86fa-074a-42e7-b9d2-7e440806c976 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:54.714334 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bd0a86fa-074a-42e7-b9d2-7e440806c976 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:54.732037 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bd0a86fa-074a-42e7-b9d2-7e440806c976 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:54.732487 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bd0a86fa-074a-42e7-b9d2-7e440806c976 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:54.733269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bd0a86fa-074a-42e7-b9d2-7e440806c976 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:54.733724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bd0a86fa-074a-42e7-b9d2-7e440806c976 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:54.904645 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bd0a86fa-074a-42e7-b9d2-7e440806c976 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:54.915972 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bd0a86fa-074a-42e7-b9d2-7e440806c976 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.212630 Jun 21 16:49:54.916834 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 81/168] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:54 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:55.932855 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2bb00c8a-9fd6-4528-ac1a-f819165b716f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:55.933518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2bb00c8a-9fd6-4528-ac1a-f819165b716f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:55.940102 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2bb00c8a-9fd6-4528-ac1a-f819165b716f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:55.940558 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2bb00c8a-9fd6-4528-ac1a-f819165b716f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:55.941450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2bb00c8a-9fd6-4528-ac1a-f819165b716f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:55.941896 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2bb00c8a-9fd6-4528-ac1a-f819165b716f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:56.121014 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2bb00c8a-9fd6-4528-ac1a-f819165b716f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:56.147091 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2bb00c8a-9fd6-4528-ac1a-f819165b716f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.215354 Jun 21 16:49:56.147091 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 88/169] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:55 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:57.163646 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c8f43575-ef10-4832-902c-54fc85fa677b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:57.164693 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c8f43575-ef10-4832-902c-54fc85fa677b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:57.172402 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c8f43575-ef10-4832-902c-54fc85fa677b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:57.172876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c8f43575-ef10-4832-902c-54fc85fa677b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:57.173637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c8f43575-ef10-4832-902c-54fc85fa677b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:57.174001 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c8f43575-ef10-4832-902c-54fc85fa677b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:57.370405 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c8f43575-ef10-4832-902c-54fc85fa677b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:57.378520 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c8f43575-ef10-4832-902c-54fc85fa677b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.219921 Jun 21 16:49:57.379204 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 82/170] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:57 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:58.018953 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fa1291bc-f968-4aa1-b9f5-986a96644e60 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Action: 'create', calling method: .version_select at 0x7f0a4361d790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1541939625", "metadata": {"Type": "work"}}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fa1291bc-f968-4aa1-b9f5-986a96644e60 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Request method failure captured: Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 122 Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfa17kkmVqy8ECqh_6FtFIOFfmlABq7oZ3mWGDeqpgZKjcybLaJwabzhngtU9-MAFLpjhKO1EURdEk9YciHKb031qGh4-A2LVvLK5vUHHvWTkMbAT61P-Yx9R97Y3NdiYsq1ok8Z_lojaMWFe6MZ4sLILrVEbocGuJSAmbTbPPBbvF0 Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:49:58.051672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_39ffd197683b49a4b8982c4bfdf03e3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 546a41305ada4e0eaf282823a355f4cb Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1541939625", "metadata": {"Type": "work"}}} Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: Jun 21 16:49:58.052925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1541939625', 'metadata': {'Type': 'work'}}}} Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise error Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:58.053870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 16:49:58.055273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 16:49:58.057177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 16:49:58.057177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.057177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fa1291bc-f968-4aa1-b9f5-986a96644e60 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:58.057177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fa1291bc-f968-4aa1-b9f5-986a96644e60 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.304260 Jun 21 16:49:58.057177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 89/171] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jun 21 16:49:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 306 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:49:58.063805 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a2227dbd-4497-41d6-96cf-9fbae672ba91 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Action: 'create', calling method: .version_select at 0x7f0a42d6aaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1517674883", "metadata": {"Type": "work"}}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a2227dbd-4497-41d6-96cf-9fbae672ba91 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Request method failure captured: Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 120 Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfa17kkmVqy8ECqh_6FtFIOFfmlABq7oZ3mWGDeqpgZKjcybLaJwabzhngtU9-MAFLpjhKO1EURdEk9YciHKb031qGh4-A2LVvLK5vUHHvWTkMbAT61P-Yx9R97Y3NdiYsq1ok8Z_lojaMWFe6MZ4sLILrVEbocGuJSAmbTbPPBbvF0 Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:49:58.067517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_39ffd197683b49a4b8982c4bfdf03e3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 546a41305ada4e0eaf282823a355f4cb Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1517674883", "metadata": {"Type": "work"}}} Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: Jun 21 16:49:58.068886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1517674883', 'metadata': {'Type': 'work'}}}} Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise error Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi '0' Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:58.069795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 16:49:58.071141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 16:49:58.073364 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 16:49:58.073364 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.073364 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a2227dbd-4497-41d6-96cf-9fbae672ba91 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:58.073364 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a2227dbd-4497-41d6-96cf-9fbae672ba91 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008937 Jun 21 16:49:58.073364 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 83/172] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jun 21 16:49:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:49:58.079227 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1f2c50ec-cf3c-467b-ba8f-cb6476963dc2 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Action: 'create', calling method: .version_select at 0x7f0a434b3940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1273786066", "metadata": {"Type": "work"}}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1f2c50ec-cf3c-467b-ba8f-cb6476963dc2 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Request method failure captured: Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 119 Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfa17kkmVqy8ECqh_6FtFIOFfmlABq7oZ3mWGDeqpgZKjcybLaJwabzhngtU9-MAFLpjhKO1EURdEk9YciHKb031qGh4-A2LVvLK5vUHHvWTkMbAT61P-Yx9R97Y3NdiYsq1ok8Z_lojaMWFe6MZ4sLILrVEbocGuJSAmbTbPPBbvF0 Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:49:58.081797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_39ffd197683b49a4b8982c4bfdf03e3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 546a41305ada4e0eaf282823a355f4cb Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1273786066", "metadata": {"Type": "work"}}} Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: Jun 21 16:49:58.083109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1273786066', 'metadata': {'Type': 'work'}}}} Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise error Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi '' Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:58.084021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 16:49:58.085218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 16:49:58.086529 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 16:49:58.086529 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.087362 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1f2c50ec-cf3c-467b-ba8f-cb6476963dc2 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:58.088376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1f2c50ec-cf3c-467b-ba8f-cb6476963dc2 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013082 Jun 21 16:49:58.088917 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 90/173] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jun 21 16:49:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 21 16:49:58.106906 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-055ca772-ea4d-4d20-807b-c89a8a34ba36 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Calling method '.version_select at 0x7f0a42d0b040>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:58.140848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-055ca772-ea4d-4d20-807b-c89a8a34ba36 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] HTTP exception thrown: Volume tempest-invalid-1392056555 could not be found. Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-055ca772-ea4d-4d20-807b-c89a8a34ba36 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Request method failure captured: Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1392056555 HTTP/1.1 Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfa17kkmVqy8ECqh_6FtFIOFfmlABq7oZ3mWGDeqpgZKjcybLaJwabzhngtU9-MAFLpjhKO1EURdEk9YciHKb031qGh4-A2LVvLK5vUHHvWTkMbAT61P-Yx9R97Y3NdiYsq1ok8Z_lojaMWFe6MZ4sLILrVEbocGuJSAmbTbPPBbvF0 Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:49:58.145411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_39ffd197683b49a4b8982c4bfdf03e3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 546a41305ada4e0eaf282823a355f4cb Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Volume tempest-invalid-1392056555 could not be found. Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': 'tempest-invalid-1392056555'} Jun 21 16:49:58.146770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1392056555 could not be found. (HTTP 404) (Request-ID: req-4d605ac5-ef94-4026-af11-b60e639a52f2) Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.147677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:49:58.148724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1392056555 could not be found. Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:49:58.150313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1392056555 could not be found. Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1392056555 could not be found. Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-055ca772-ea4d-4d20-807b-c89a8a34ba36 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Returning 404 to user: Volume tempest-invalid-1392056555 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-055ca772-ea4d-4d20-807b-c89a8a34ba36 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1392056555" status: 404 len: 99 microversion: 2.1 time: 0.045630 Jun 21 16:49:58.151508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 84/174] 10.222.0.70 () {58 vars in 1217 bytes} [Tue Jun 21 16:49:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1392056555 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 21 16:49:58.160817 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0420c862-4687-4057-af93-bf6f09db165c tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007101 Jun 21 16:49:58.164587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 91/175] 10.222.0.70 () {58 vars in 1139 bytes} [Tue Jun 21 16:49:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 16:49:58.172963 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9cb6eb97-90cc-4737-9e9c-821627f80299 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003687 Jun 21 16:49:58.173584 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 85/176] 10.222.0.70 () {58 vars in 1136 bytes} [Tue Jun 21 16:49:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 16:49:58.183106 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fb81fec4-2469-4f0a-a092-db5c63af697b tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Calling method '.version_select at 0x7f0a4361d5e0>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:58.215290 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-fb81fec4-2469-4f0a-a092-db5c63af697b tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] HTTP exception thrown: Volume 660e13b2-b503-4c11-ac32-b930724fd838 could not be found. Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fb81fec4-2469-4f0a-a092-db5c63af697b tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Request method failure captured: Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: DELETE /compute/v2.1/os-volumes/660e13b2-b503-4c11-ac32-b930724fd838 HTTP/1.1 Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfa17kkmVqy8ECqh_6FtFIOFfmlABq7oZ3mWGDeqpgZKjcybLaJwabzhngtU9-MAFLpjhKO1EURdEk9YciHKb031qGh4-A2LVvLK5vUHHvWTkMbAT61P-Yx9R97Y3NdiYsq1ok8Z_lojaMWFe6MZ4sLILrVEbocGuJSAmbTbPPBbvF0 Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:49:58.217588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_39ffd197683b49a4b8982c4bfdf03e3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 546a41305ada4e0eaf282823a355f4cb Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Volume 660e13b2-b503-4c11-ac32-b930724fd838 could not be found. Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '660e13b2-b503-4c11-ac32-b930724fd838'} Jun 21 16:49:58.219131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 660e13b2-b503-4c11-ac32-b930724fd838 could not be found. (HTTP 404) (Request-ID: req-125dbb0d-5791-4dc9-864e-fcf593ff16c7) Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.224602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:49:58.226385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 660e13b2-b503-4c11-ac32-b930724fd838 could not be found. Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 16:49:58.228358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 660e13b2-b503-4c11-ac32-b930724fd838 could not be found. Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 660e13b2-b503-4c11-ac32-b930724fd838 could not be found. Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fb81fec4-2469-4f0a-a092-db5c63af697b tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Returning 404 to user: Volume 660e13b2-b503-4c11-ac32-b930724fd838 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fb81fec4-2469-4f0a-a092-db5c63af697b tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/660e13b2-b503-4c11-ac32-b930724fd838" status: 404 len: 109 microversion: 2.1 time: 0.040468 Jun 21 16:49:58.230644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 92/177] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:49:58 2022] DELETE /compute/v2.1/os-volumes/660e13b2-b503-4c11-ac32-b930724fd838 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:49:58.232205 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-78f4c216-445a-488e-96f1-ec5e1d32a545 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Calling method '.version_select at 0x7f0a42d104c0>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:58.275386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-78f4c216-445a-488e-96f1-ec5e1d32a545 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] HTTP exception thrown: Volume 43137150-0259-4245-a3ad-ab73a0bc005b could not be found. Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-78f4c216-445a-488e-96f1-ec5e1d32a545 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Request method failure captured: Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/os-volumes/43137150-0259-4245-a3ad-ab73a0bc005b HTTP/1.1 Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfa17kkmVqy8ECqh_6FtFIOFfmlABq7oZ3mWGDeqpgZKjcybLaJwabzhngtU9-MAFLpjhKO1EURdEk9YciHKb031qGh4-A2LVvLK5vUHHvWTkMbAT61P-Yx9R97Y3NdiYsq1ok8Z_lojaMWFe6MZ4sLILrVEbocGuJSAmbTbPPBbvF0 Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:49:58.277697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/39ffd197683b49a4b8982c4bfdf03e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_39ffd197683b49a4b8982c4bfdf03e3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 39ffd197683b49a4b8982c4bfdf03e3a Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-VolumesNegativeTest-1309095917 Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 546a41305ada4e0eaf282823a355f4cb Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-VolumesNegativeTest-1309095917-project Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Volume 43137150-0259-4245-a3ad-ab73a0bc005b could not be found. Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '43137150-0259-4245-a3ad-ab73a0bc005b'} Jun 21 16:49:58.279071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43137150-0259-4245-a3ad-ab73a0bc005b could not be found. (HTTP 404) (Request-ID: req-a069b303-72fe-46d7-92ce-33bcbb0c86ff) Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.279814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:49:58.280859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43137150-0259-4245-a3ad-ab73a0bc005b could not be found. Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 16:49:58.282468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43137150-0259-4245-a3ad-ab73a0bc005b could not be found. Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43137150-0259-4245-a3ad-ab73a0bc005b could not be found. Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-78f4c216-445a-488e-96f1-ec5e1d32a545 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] Returning 404 to user: Volume 43137150-0259-4245-a3ad-ab73a0bc005b could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-78f4c216-445a-488e-96f1-ec5e1d32a545 tempest-VolumesNegativeTest-1309095917 tempest-VolumesNegativeTest-1309095917-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/43137150-0259-4245-a3ad-ab73a0bc005b" status: 404 len: 109 microversion: 2.1 time: 0.053796 Jun 21 16:49:58.283707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 86/178] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:49:58 2022] GET /compute/v2.1/os-volumes/43137150-0259-4245-a3ad-ab73a0bc005b => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 16:49:58.396266 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5ca70027-2e3d-42c8-80d3-e5bb0a900613 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:58.397111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5ca70027-2e3d-42c8-80d3-e5bb0a900613 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:58.411571 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5ca70027-2e3d-42c8-80d3-e5bb0a900613 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:58.412264 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5ca70027-2e3d-42c8-80d3-e5bb0a900613 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:58.413186 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5ca70027-2e3d-42c8-80d3-e5bb0a900613 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:58.413848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5ca70027-2e3d-42c8-80d3-e5bb0a900613 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:58.561948 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-5ca70027-2e3d-42c8-80d3-e5bb0a900613 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:58.572329 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5ca70027-2e3d-42c8-80d3-e5bb0a900613 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.180050 Jun 21 16:49:58.572916 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 93/179] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:58 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:49:59.589316 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-def1a1e3-6e63-4e36-8e0d-4185b43c7c04 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:49:59.589963 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-def1a1e3-6e63-4e36-8e0d-4185b43c7c04 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:49:59.597694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-def1a1e3-6e63-4e36-8e0d-4185b43c7c04 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:59.598553 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-def1a1e3-6e63-4e36-8e0d-4185b43c7c04 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:59.599527 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-def1a1e3-6e63-4e36-8e0d-4185b43c7c04 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:49:59.600107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-def1a1e3-6e63-4e36-8e0d-4185b43c7c04 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:49:59.760924 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-def1a1e3-6e63-4e36-8e0d-4185b43c7c04 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:49:59.769059 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-def1a1e3-6e63-4e36-8e0d-4185b43c7c04 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.183344 Jun 21 16:49:59.770184 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 87/180] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:49:59 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:00.787999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7d6b430a-8cc1-468a-9661-c04d6bba536a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:00.789464 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7d6b430a-8cc1-468a-9661-c04d6bba536a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:00.797590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7d6b430a-8cc1-468a-9661-c04d6bba536a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:00.798172 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7d6b430a-8cc1-468a-9661-c04d6bba536a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:00.799035 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7d6b430a-8cc1-468a-9661-c04d6bba536a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:00.799653 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7d6b430a-8cc1-468a-9661-c04d6bba536a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:00.943999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7d6b430a-8cc1-468a-9661-c04d6bba536a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:00.952361 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7d6b430a-8cc1-468a-9661-c04d6bba536a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.168210 Jun 21 16:50:00.953180 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 94/181] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:00 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:01.969494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7fc1c596-65c2-43ee-9d4a-9e9232d6e539 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:01.970205 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-7fc1c596-65c2-43ee-9d4a-9e9232d6e539 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:01.976674 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7fc1c596-65c2-43ee-9d4a-9e9232d6e539 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:01.977119 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7fc1c596-65c2-43ee-9d4a-9e9232d6e539 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:01.977973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7fc1c596-65c2-43ee-9d4a-9e9232d6e539 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:01.978461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7fc1c596-65c2-43ee-9d4a-9e9232d6e539 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:02.161765 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-7fc1c596-65c2-43ee-9d4a-9e9232d6e539 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:02.170406 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-7fc1c596-65c2-43ee-9d4a-9e9232d6e539 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.204585 Jun 21 16:50:02.170969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 88/182] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:01 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:03.188167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8ea9716d-b669-4434-b53b-b41ea2eeb443 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:03.188770 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8ea9716d-b669-4434-b53b-b41ea2eeb443 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:03.195386 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ea9716d-b669-4434-b53b-b41ea2eeb443 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:03.195827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ea9716d-b669-4434-b53b-b41ea2eeb443 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:03.196583 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ea9716d-b669-4434-b53b-b41ea2eeb443 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:03.197764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ea9716d-b669-4434-b53b-b41ea2eeb443 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:03.353357 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8ea9716d-b669-4434-b53b-b41ea2eeb443 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:03.362984 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8ea9716d-b669-4434-b53b-b41ea2eeb443 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.178250 Jun 21 16:50:03.364233 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 95/183] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:03 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:04.381247 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-25ab3c23-eaab-45af-9537-6f74ef72852f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:04.381898 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-25ab3c23-eaab-45af-9537-6f74ef72852f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:04.398578 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25ab3c23-eaab-45af-9537-6f74ef72852f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:04.399464 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25ab3c23-eaab-45af-9537-6f74ef72852f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:04.400772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25ab3c23-eaab-45af-9537-6f74ef72852f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:04.401641 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25ab3c23-eaab-45af-9537-6f74ef72852f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:04.603610 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-25ab3c23-eaab-45af-9537-6f74ef72852f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:04.615457 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-25ab3c23-eaab-45af-9537-6f74ef72852f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.237756 Jun 21 16:50:04.622621 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 89/184] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:04 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:05.633417 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8705610e-d6b9-4054-bd3b-268cc378ccb5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:05.634041 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8705610e-d6b9-4054-bd3b-268cc378ccb5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:05.642150 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8705610e-d6b9-4054-bd3b-268cc378ccb5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:05.642628 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8705610e-d6b9-4054-bd3b-268cc378ccb5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:05.643454 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8705610e-d6b9-4054-bd3b-268cc378ccb5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:05.643894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8705610e-d6b9-4054-bd3b-268cc378ccb5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:05.828722 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8705610e-d6b9-4054-bd3b-268cc378ccb5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:05.839398 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8705610e-d6b9-4054-bd3b-268cc378ccb5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.210000 Jun 21 16:50:05.840217 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 96/185] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:05 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:06.860490 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a88c37e4-397a-4546-a62b-07dd34dce571 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:06.861139 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a88c37e4-397a-4546-a62b-07dd34dce571 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:06.868126 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a88c37e4-397a-4546-a62b-07dd34dce571 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:06.869801 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a88c37e4-397a-4546-a62b-07dd34dce571 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:06.870598 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a88c37e4-397a-4546-a62b-07dd34dce571 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:06.871209 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a88c37e4-397a-4546-a62b-07dd34dce571 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:07.014185 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a88c37e4-397a-4546-a62b-07dd34dce571 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:07.027723 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a88c37e4-397a-4546-a62b-07dd34dce571 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.171477 Jun 21 16:50:07.028395 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 90/186] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:06 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:08.044661 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b7073578-96ef-479c-94ec-64b223db5e32 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:08.045518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b7073578-96ef-479c-94ec-64b223db5e32 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:08.048082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=38 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:08.053028 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b7073578-96ef-479c-94ec-64b223db5e32 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:08.053511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b7073578-96ef-479c-94ec-64b223db5e32 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:08.054381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b7073578-96ef-479c-94ec-64b223db5e32 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:08.054808 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b7073578-96ef-479c-94ec-64b223db5e32 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:08.227197 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b7073578-96ef-479c-94ec-64b223db5e32 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:08.236009 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b7073578-96ef-479c-94ec-64b223db5e32 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.195606 Jun 21 16:50:08.236794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 97/187] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:08 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:09.253674 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4880d2ae-e2d4-4adb-a7d8-0c9a04b5637b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:09.257858 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4880d2ae-e2d4-4adb-a7d8-0c9a04b5637b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:09.268823 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4880d2ae-e2d4-4adb-a7d8-0c9a04b5637b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:09.269837 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4880d2ae-e2d4-4adb-a7d8-0c9a04b5637b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:09.271183 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4880d2ae-e2d4-4adb-a7d8-0c9a04b5637b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:09.272257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4880d2ae-e2d4-4adb-a7d8-0c9a04b5637b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:09.415909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4880d2ae-e2d4-4adb-a7d8-0c9a04b5637b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:09.424271 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4880d2ae-e2d4-4adb-a7d8-0c9a04b5637b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.174002 Jun 21 16:50:09.425102 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 91/188] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:09 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:10.442894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b33df14a-3ec8-4a91-981c-1ba70345b9b1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:10.443500 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b33df14a-3ec8-4a91-981c-1ba70345b9b1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:10.452430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b33df14a-3ec8-4a91-981c-1ba70345b9b1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:10.453159 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b33df14a-3ec8-4a91-981c-1ba70345b9b1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:10.454139 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b33df14a-3ec8-4a91-981c-1ba70345b9b1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:10.454567 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b33df14a-3ec8-4a91-981c-1ba70345b9b1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:10.606803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b33df14a-3ec8-4a91-981c-1ba70345b9b1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:10.614726 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b33df14a-3ec8-4a91-981c-1ba70345b9b1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.175761 Jun 21 16:50:10.615302 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 98/189] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:10 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:11.633563 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-35c462ba-6f40-4a01-85f0-fb0e93d58995 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:11.634226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-35c462ba-6f40-4a01-85f0-fb0e93d58995 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:11.636086 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:11.641425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-35c462ba-6f40-4a01-85f0-fb0e93d58995 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:11.642194 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-35c462ba-6f40-4a01-85f0-fb0e93d58995 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:11.642615 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-35c462ba-6f40-4a01-85f0-fb0e93d58995 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:11.643033 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-35c462ba-6f40-4a01-85f0-fb0e93d58995 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:11.784662 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-35c462ba-6f40-4a01-85f0-fb0e93d58995 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:11.796973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-35c462ba-6f40-4a01-85f0-fb0e93d58995 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.166554 Jun 21 16:50:11.804655 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 92/190] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:11 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:12.820378 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-562194a4-f914-4d1d-acd7-562233ec9420 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:12.821137 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-562194a4-f914-4d1d-acd7-562233ec9420 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:12.828946 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-562194a4-f914-4d1d-acd7-562233ec9420 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:12.829439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-562194a4-f914-4d1d-acd7-562233ec9420 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:12.830214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-562194a4-f914-4d1d-acd7-562233ec9420 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:12.830863 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-562194a4-f914-4d1d-acd7-562233ec9420 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:12.975211 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-562194a4-f914-4d1d-acd7-562233ec9420 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:12.984379 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-562194a4-f914-4d1d-acd7-562233ec9420 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.168048 Jun 21 16:50:12.985124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 99/191] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:12 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:14.003858 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5c53e0e7-b472-4bcb-ac8e-413387ec0e8b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:14.004454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5c53e0e7-b472-4bcb-ac8e-413387ec0e8b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:14.010620 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5c53e0e7-b472-4bcb-ac8e-413387ec0e8b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:14.011061 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5c53e0e7-b472-4bcb-ac8e-413387ec0e8b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:14.012984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5c53e0e7-b472-4bcb-ac8e-413387ec0e8b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:14.013468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5c53e0e7-b472-4bcb-ac8e-413387ec0e8b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:14.151331 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5c53e0e7-b472-4bcb-ac8e-413387ec0e8b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:14.159170 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5c53e0e7-b472-4bcb-ac8e-413387ec0e8b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.159459 Jun 21 16:50:14.159748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 93/192] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:13 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:15.176494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fcf59532-4a0c-49c4-a2a4-e12a44555e5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:15.177529 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fcf59532-4a0c-49c4-a2a4-e12a44555e5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:15.184780 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fcf59532-4a0c-49c4-a2a4-e12a44555e5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:15.185251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fcf59532-4a0c-49c4-a2a4-e12a44555e5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:15.186064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fcf59532-4a0c-49c4-a2a4-e12a44555e5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:15.186490 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fcf59532-4a0c-49c4-a2a4-e12a44555e5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:15.321871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fcf59532-4a0c-49c4-a2a4-e12a44555e5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:15.337550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fcf59532-4a0c-49c4-a2a4-e12a44555e5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.158211 Jun 21 16:50:15.337550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 100/193] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:15 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:16.350546 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7095e0cd-2da1-4c95-9ae0-d89c05210410 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:16.351438 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-7095e0cd-2da1-4c95-9ae0-d89c05210410 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:16.359488 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7095e0cd-2da1-4c95-9ae0-d89c05210410 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:16.359937 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7095e0cd-2da1-4c95-9ae0-d89c05210410 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:16.361179 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7095e0cd-2da1-4c95-9ae0-d89c05210410 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:16.361652 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7095e0cd-2da1-4c95-9ae0-d89c05210410 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:16.506571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-7095e0cd-2da1-4c95-9ae0-d89c05210410 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:16.514540 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-7095e0cd-2da1-4c95-9ae0-d89c05210410 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.167760 Jun 21 16:50:16.515114 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 94/194] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:16 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:17.531828 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-316845a7-2448-446f-8c9e-b13cec83364a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:17.532598 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-316845a7-2448-446f-8c9e-b13cec83364a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:17.539140 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-316845a7-2448-446f-8c9e-b13cec83364a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:17.539587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-316845a7-2448-446f-8c9e-b13cec83364a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:17.540343 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-316845a7-2448-446f-8c9e-b13cec83364a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:17.540776 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-316845a7-2448-446f-8c9e-b13cec83364a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:17.543876 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=95 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:17.687902 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-316845a7-2448-446f-8c9e-b13cec83364a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:17.689535 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-316845a7-2448-446f-8c9e-b13cec83364a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.161612 Jun 21 16:50:17.690104 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 101/195] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:17 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:18.706408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-13fff0ea-33a7-448e-b659-14b7b4f85eea tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:18.707007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-13fff0ea-33a7-448e-b659-14b7b4f85eea tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:18.713042 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-13fff0ea-33a7-448e-b659-14b7b4f85eea tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:18.713517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-13fff0ea-33a7-448e-b659-14b7b4f85eea tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:18.714268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-13fff0ea-33a7-448e-b659-14b7b4f85eea tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:18.714706 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-13fff0ea-33a7-448e-b659-14b7b4f85eea tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:18.850093 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-13fff0ea-33a7-448e-b659-14b7b4f85eea tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:18.858709 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-13fff0ea-33a7-448e-b659-14b7b4f85eea tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.155993 Jun 21 16:50:18.859700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 95/196] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:18 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:19.876645 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-91c0e8d0-2f03-46ca-835d-7edb1f028c13 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:19.877303 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-91c0e8d0-2f03-46ca-835d-7edb1f028c13 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:19.884083 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-91c0e8d0-2f03-46ca-835d-7edb1f028c13 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:19.884531 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-91c0e8d0-2f03-46ca-835d-7edb1f028c13 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:19.885343 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-91c0e8d0-2f03-46ca-835d-7edb1f028c13 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:19.885806 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-91c0e8d0-2f03-46ca-835d-7edb1f028c13 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:20.020138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-91c0e8d0-2f03-46ca-835d-7edb1f028c13 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:20.027880 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-91c0e8d0-2f03-46ca-835d-7edb1f028c13 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1522 microversion: 2.1 time: 0.155545 Jun 21 16:50:20.028965 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 102/197] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:19 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:21.047846 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-86d41555-9243-4e6b-8ef2-e1b2cf4f6301 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:21.048889 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-86d41555-9243-4e6b-8ef2-e1b2cf4f6301 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:21.056278 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-86d41555-9243-4e6b-8ef2-e1b2cf4f6301 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:21.064415 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-86d41555-9243-4e6b-8ef2-e1b2cf4f6301 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:21.064415 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-86d41555-9243-4e6b-8ef2-e1b2cf4f6301 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:21.064415 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-86d41555-9243-4e6b-8ef2-e1b2cf4f6301 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:21.066164 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=83 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:21.207741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-86d41555-9243-4e6b-8ef2-e1b2cf4f6301 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:21.212608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-86d41555-9243-4e6b-8ef2-e1b2cf4f6301 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1502 microversion: 2.1 time: 0.170909 Jun 21 16:50:21.213176 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 96/198] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:21 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:21.229950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-41b9edf9-e186-4797-b655-3b79b3bc0385 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:21.230552 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-41b9edf9-e186-4797-b655-3b79b3bc0385 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:21.237165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-41b9edf9-e186-4797-b655-3b79b3bc0385 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:21.242204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-41b9edf9-e186-4797-b655-3b79b3bc0385 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:21.242204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-41b9edf9-e186-4797-b655-3b79b3bc0385 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:21.242204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-41b9edf9-e186-4797-b655-3b79b3bc0385 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:21.410152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-41b9edf9-e186-4797-b655-3b79b3bc0385 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:21.417628 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-41b9edf9-e186-4797-b655-3b79b3bc0385 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1517 microversion: 2.1 time: 0.192173 Jun 21 16:50:21.418198 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 103/199] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:21 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:23.801539 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8ea2e8fc-a127-4a83-934b-8c519d4c6e25 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:23.803260 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8ea2e8fc-a127-4a83-934b-8c519d4c6e25 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:23.813845 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8ea2e8fc-a127-4a83-934b-8c519d4c6e25 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:23.814546 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8ea2e8fc-a127-4a83-934b-8c519d4c6e25 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:23.815637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8ea2e8fc-a127-4a83-934b-8c519d4c6e25 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:23.816311 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8ea2e8fc-a127-4a83-934b-8c519d4c6e25 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:23.866799 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-8ea2e8fc-a127-4a83-934b-8c519d4c6e25 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lazy-loading 'flavor' on Instance uuid b12e3b57-72af-4292-ba65-d90c166a49ed {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:50:24.488863 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8ea2e8fc-a127-4a83-934b-8c519d4c6e25 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed/action" status: 200 len: 32 microversion: 2.1 time: 0.694956 Jun 21 16:50:24.493829 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 97/200] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:50:23 2022] POST /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed/action => generated 32 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:50:24.499867 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-56d9c8b5-df5c-4aa3-9b9b-c792801a34f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:24.504498 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-56d9c8b5-df5c-4aa3-9b9b-c792801a34f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:24.508316 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-56d9c8b5-df5c-4aa3-9b9b-c792801a34f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:24.508964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-56d9c8b5-df5c-4aa3-9b9b-c792801a34f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:24.510101 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-56d9c8b5-df5c-4aa3-9b9b-c792801a34f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:24.510787 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-56d9c8b5-df5c-4aa3-9b9b-c792801a34f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:24.699570 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-56d9c8b5-df5c-4aa3-9b9b-c792801a34f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:24.709964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-56d9c8b5-df5c-4aa3-9b9b-c792801a34f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.214975 Jun 21 16:50:24.710545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 104/201] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:24 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:25.731170 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-911f93be-c109-49e0-ae42-56e92c898c3b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:25.731878 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-911f93be-c109-49e0-ae42-56e92c898c3b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:25.747013 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-911f93be-c109-49e0-ae42-56e92c898c3b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:25.747969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-911f93be-c109-49e0-ae42-56e92c898c3b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:25.748756 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-911f93be-c109-49e0-ae42-56e92c898c3b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:25.749192 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-911f93be-c109-49e0-ae42-56e92c898c3b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:25.891313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-911f93be-c109-49e0-ae42-56e92c898c3b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:25.898922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-911f93be-c109-49e0-ae42-56e92c898c3b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.175656 Jun 21 16:50:25.899502 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 98/202] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:25 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:26.916132 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6f7e25dc-2886-4d4a-b7c3-66b5e1a878f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:26.917626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6f7e25dc-2886-4d4a-b7c3-66b5e1a878f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:26.926708 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6f7e25dc-2886-4d4a-b7c3-66b5e1a878f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:26.927419 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6f7e25dc-2886-4d4a-b7c3-66b5e1a878f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:26.928365 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6f7e25dc-2886-4d4a-b7c3-66b5e1a878f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:26.928951 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6f7e25dc-2886-4d4a-b7c3-66b5e1a878f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:27.102868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6f7e25dc-2886-4d4a-b7c3-66b5e1a878f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:27.110770 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6f7e25dc-2886-4d4a-b7c3-66b5e1a878f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.198610 Jun 21 16:50:27.111350 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 105/203] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:26 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:28.128518 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9cf53c4d-92a6-41f2-bc90-d8ef68cecfc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:28.129208 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9cf53c4d-92a6-41f2-bc90-d8ef68cecfc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:28.136768 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9cf53c4d-92a6-41f2-bc90-d8ef68cecfc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:28.137307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9cf53c4d-92a6-41f2-bc90-d8ef68cecfc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:28.138169 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9cf53c4d-92a6-41f2-bc90-d8ef68cecfc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:28.139407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9cf53c4d-92a6-41f2-bc90-d8ef68cecfc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:28.307995 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9cf53c4d-92a6-41f2-bc90-d8ef68cecfc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:28.317737 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9cf53c4d-92a6-41f2-bc90-d8ef68cecfc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.192821 Jun 21 16:50:28.318569 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 99/204] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:28 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:29.336044 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a93e72b1-04d2-4ebe-9952-d30086d53cc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:29.338220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a93e72b1-04d2-4ebe-9952-d30086d53cc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:29.347079 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a93e72b1-04d2-4ebe-9952-d30086d53cc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:29.347279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a93e72b1-04d2-4ebe-9952-d30086d53cc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:29.348063 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a93e72b1-04d2-4ebe-9952-d30086d53cc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:29.348555 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a93e72b1-04d2-4ebe-9952-d30086d53cc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:29.526187 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a93e72b1-04d2-4ebe-9952-d30086d53cc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:29.536265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a93e72b1-04d2-4ebe-9952-d30086d53cc3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.204112 Jun 21 16:50:29.543349 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 106/205] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:29 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:30.260296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1154757396", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "networks": [{"uuid": "5cf6e549-6d0a-4c00-bdfa-de021fc82834"}]}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:30.352519 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.network.neutron [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] validate_networks() for [('5cf6e549-6d0a-4c00-bdfa-de021fc82834', None, None, None, None, None)] {{(pid=124686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:50:30.556923 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-90fed848-cc98-4dc0-96f5-5b76e6aa2805 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:30.557773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-90fed848-cc98-4dc0-96f5-5b76e6aa2805 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:30.564744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-90fed848-cc98-4dc0-96f5-5b76e6aa2805 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:30.565190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-90fed848-cc98-4dc0-96f5-5b76e6aa2805 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:30.565999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-90fed848-cc98-4dc0-96f5-5b76e6aa2805 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:30.566429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-90fed848-cc98-4dc0-96f5-5b76e6aa2805 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:30.707755 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-90fed848-cc98-4dc0-96f5-5b76e6aa2805 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:30.715740 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-90fed848-cc98-4dc0-96f5-5b76e6aa2805 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.162610 Jun 21 16:50:30.716311 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 107/206] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:30 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:30.867780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Flavor limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:50:30.868712 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Image limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:50:30.869774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Flavor pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:50:30.870275 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Image pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:50:30.870963 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:50:30.888945 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:30.893118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:30.894079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:30.894741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:30.913591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Getting quotas for project 83fb026ffcbd4a71929a4b3c860b3bee. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:50:30.918245 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Getting quotas for user 127c04cf84664a7582853dec90f130b6 and project 83fb026ffcbd4a71929a4b3c860b3bee. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:50:30.931944 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Going to run 1 instances... {{(pid=124686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:50:30.934717 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:50:31.095419 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a5457009-fe27-46df-a84b-3dde3ff85bfa tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838775 Jun 21 16:50:31.096331 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 100/207] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:50:31.114556 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8b19ad87-45fe-4ee4-8055-4233ffba0429 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:31.115368 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8b19ad87-45fe-4ee4-8055-4233ffba0429 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:31.182204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8b19ad87-45fe-4ee4-8055-4233ffba0429 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:31.194707 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8b19ad87-45fe-4ee4-8055-4233ffba0429 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1214 microversion: 2.1 time: 0.089952 Jun 21 16:50:31.196551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 108/208] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:31 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:31.735031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-12d41602-9312-49b7-a5a2-4a3e034f15e9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:31.735640 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-12d41602-9312-49b7-a5a2-4a3e034f15e9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:31.742170 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-12d41602-9312-49b7-a5a2-4a3e034f15e9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:31.742617 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-12d41602-9312-49b7-a5a2-4a3e034f15e9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:31.743430 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-12d41602-9312-49b7-a5a2-4a3e034f15e9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:31.743862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-12d41602-9312-49b7-a5a2-4a3e034f15e9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:31.887356 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-12d41602-9312-49b7-a5a2-4a3e034f15e9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:31.895785 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-12d41602-9312-49b7-a5a2-4a3e034f15e9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.164697 Jun 21 16:50:31.896345 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 101/209] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:31 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:32.213267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-eaa02187-6273-4cdf-89cf-8f79cbaf4760 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:32.214456 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-eaa02187-6273-4cdf-89cf-8f79cbaf4760 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:32.271450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-eaa02187-6273-4cdf-89cf-8f79cbaf4760 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:32.279428 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-eaa02187-6273-4cdf-89cf-8f79cbaf4760 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1214 microversion: 2.1 time: 0.070007 Jun 21 16:50:32.280518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 109/210] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:32 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:32.914071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-03ab5bcd-0245-4483-8ba7-64136afba67b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:32.914678 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-03ab5bcd-0245-4483-8ba7-64136afba67b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:32.921702 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03ab5bcd-0245-4483-8ba7-64136afba67b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:32.922793 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03ab5bcd-0245-4483-8ba7-64136afba67b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:32.923552 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03ab5bcd-0245-4483-8ba7-64136afba67b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:32.923989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03ab5bcd-0245-4483-8ba7-64136afba67b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:33.059862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-03ab5bcd-0245-4483-8ba7-64136afba67b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:33.068653 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-03ab5bcd-0245-4483-8ba7-64136afba67b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.158453 Jun 21 16:50:33.069229 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 102/211] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:32 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:33.157371 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-96a14efa-d933-41e8-8d49-c5ee86b2fcbb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:33.157861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-96a14efa-d933-41e8-8d49-c5ee86b2fcbb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:33.163841 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-96a14efa-d933-41e8-8d49-c5ee86b2fcbb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:33.164277 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-96a14efa-d933-41e8-8d49-c5ee86b2fcbb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:33.165020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-96a14efa-d933-41e8-8d49-c5ee86b2fcbb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:33.165502 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-96a14efa-d933-41e8-8d49-c5ee86b2fcbb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:33.191826 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-96a14efa-d933-41e8-8d49-c5ee86b2fcbb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/ips" status: 200 len: 151 microversion: 2.20 time: 0.038921 Jun 21 16:50:33.192464 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 110/212] 10.222.0.70 () {60 vars in 1288 bytes} [Tue Jun 21 16:50:33 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:50:33.297912 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6e87b181-7140-4f36-bf5c-9d5950324e4d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:33.298610 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6e87b181-7140-4f36-bf5c-9d5950324e4d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:33.304663 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6e87b181-7140-4f36-bf5c-9d5950324e4d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:33.305222 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6e87b181-7140-4f36-bf5c-9d5950324e4d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:33.305886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6e87b181-7140-4f36-bf5c-9d5950324e4d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:33.306308 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6e87b181-7140-4f36-bf5c-9d5950324e4d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:33.376656 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6e87b181-7140-4f36-bf5c-9d5950324e4d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:33.384623 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6e87b181-7140-4f36-bf5c-9d5950324e4d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1266 microversion: 2.1 time: 0.090885 Jun 21 16:50:33.385704 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 103/213] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:33 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:34.094503 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-19acc896-6f4c-4404-9036-8c8edd163471 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:34.095138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-19acc896-6f4c-4404-9036-8c8edd163471 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:34.117557 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-19acc896-6f4c-4404-9036-8c8edd163471 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:34.118016 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-19acc896-6f4c-4404-9036-8c8edd163471 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:34.121622 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-19acc896-6f4c-4404-9036-8c8edd163471 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:34.124726 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-19acc896-6f4c-4404-9036-8c8edd163471 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:34.297060 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-19acc896-6f4c-4404-9036-8c8edd163471 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:34.305706 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-19acc896-6f4c-4404-9036-8c8edd163471 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.222768 Jun 21 16:50:34.306390 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 111/214] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:34 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:34.406095 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-26267ed5-9fc7-4303-a90e-20483fabddd3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:34.406642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-26267ed5-9fc7-4303-a90e-20483fabddd3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:34.422842 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26267ed5-9fc7-4303-a90e-20483fabddd3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:34.423385 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26267ed5-9fc7-4303-a90e-20483fabddd3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:34.424419 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26267ed5-9fc7-4303-a90e-20483fabddd3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:34.424865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26267ed5-9fc7-4303-a90e-20483fabddd3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:34.579000 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-26267ed5-9fc7-4303-a90e-20483fabddd3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:34.587068 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-26267ed5-9fc7-4303-a90e-20483fabddd3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.185956 Jun 21 16:50:34.587638 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 104/215] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:34 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:35.323457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bcd3c721-0221-411b-b277-60a080d8951f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:35.324058 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-bcd3c721-0221-411b-b277-60a080d8951f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:35.331522 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bcd3c721-0221-411b-b277-60a080d8951f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:35.332080 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bcd3c721-0221-411b-b277-60a080d8951f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:35.332855 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bcd3c721-0221-411b-b277-60a080d8951f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:35.333373 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bcd3c721-0221-411b-b277-60a080d8951f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:35.480013 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-bcd3c721-0221-411b-b277-60a080d8951f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:35.489227 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-bcd3c721-0221-411b-b277-60a080d8951f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.169734 Jun 21 16:50:35.500211 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 112/216] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:35 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:35.604301 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6416f531-6030-40b7-bdae-637f3ff6b4e3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:35.605033 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6416f531-6030-40b7-bdae-637f3ff6b4e3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:35.616716 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6416f531-6030-40b7-bdae-637f3ff6b4e3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:35.617885 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6416f531-6030-40b7-bdae-637f3ff6b4e3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:35.618828 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6416f531-6030-40b7-bdae-637f3ff6b4e3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:35.619592 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6416f531-6030-40b7-bdae-637f3ff6b4e3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:35.625831 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-624eb3c9-b443-45e5-b877-a45a69dbca38 req-4f813788-c9a9-47b3-b6be-475426fe9390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a79925a-5102-4509-af82-8a896c6037a6", "tag": "e727baaf-4a67-418e-bfc1-1564e9b5f9bf"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:35.635212 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-624eb3c9-b443-45e5-b877-a45a69dbca38 req-4f813788-c9a9-47b3-b6be-475426fe9390 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:35.635757 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-624eb3c9-b443-45e5-b877-a45a69dbca38 req-4f813788-c9a9-47b3-b6be-475426fe9390 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:35.648494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-624eb3c9-b443-45e5-b877-a45a69dbca38 req-4f813788-c9a9-47b3-b6be-475426fe9390 service nova] Creating event network-changed:e727baaf-4a67-418e-bfc1-1564e9b5f9bf for instance 7a79925a-5102-4509-af82-8a896c6037a6 on hv-cinder-79987 Jun 21 16:50:35.652947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-624eb3c9-b443-45e5-b877-a45a69dbca38 req-4f813788-c9a9-47b3-b6be-475426fe9390 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030938 Jun 21 16:50:35.654104 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 113/217] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:50:35.896193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6416f531-6030-40b7-bdae-637f3ff6b4e3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:35.921794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6416f531-6030-40b7-bdae-637f3ff6b4e3 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.314991 Jun 21 16:50:35.921794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 105/218] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:35 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:36.367888 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-93927e46-44d7-4642-bc53-e84aa2317865 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:36.368691 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-93927e46-44d7-4642-bc53-e84aa2317865 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:36.378083 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-93927e46-44d7-4642-bc53-e84aa2317865 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:36.378532 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-93927e46-44d7-4642-bc53-e84aa2317865 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:36.379355 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-93927e46-44d7-4642-bc53-e84aa2317865 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:36.379919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-93927e46-44d7-4642-bc53-e84aa2317865 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:36.407773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-93927e46-44d7-4642-bc53-e84aa2317865 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lazy-loading 'flavor' on Instance uuid 0d9af742-a7f3-4113-8ace-571502dad309 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:50:36.513412 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-12ea0888-3973-480c-bfd2-b8e14abf98d3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:36.514494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-12ea0888-3973-480c-bfd2-b8e14abf98d3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:36.522648 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-12ea0888-3973-480c-bfd2-b8e14abf98d3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:36.527300 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-12ea0888-3973-480c-bfd2-b8e14abf98d3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:36.527300 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-12ea0888-3973-480c-bfd2-b8e14abf98d3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:36.527300 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-12ea0888-3973-480c-bfd2-b8e14abf98d3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:36.816879 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-12ea0888-3973-480c-bfd2-b8e14abf98d3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:36.824404 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-12ea0888-3973-480c-bfd2-b8e14abf98d3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.321426 Jun 21 16:50:36.835882 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 106/219] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:36 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:36.932627 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3debf862-7091-4dc1-afd1-987126e49167 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:36.933373 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3debf862-7091-4dc1-afd1-987126e49167 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:36.939654 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3debf862-7091-4dc1-afd1-987126e49167 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:36.940145 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3debf862-7091-4dc1-afd1-987126e49167 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:36.940946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3debf862-7091-4dc1-afd1-987126e49167 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:36.941401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3debf862-7091-4dc1-afd1-987126e49167 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:37.031882 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-93927e46-44d7-4642-bc53-e84aa2317865 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/action" status: 202 len: 0 microversion: 2.20 time: 0.668353 Jun 21 16:50:37.033453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 114/220] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jun 21 16:50:36 2022] POST /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:50:37.053770 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:37.054664 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:37.063424 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:37.063878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:37.064654 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:37.065085 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:37.110887 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3debf862-7091-4dc1-afd1-987126e49167 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:37.119180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3debf862-7091-4dc1-afd1-987126e49167 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.190473 Jun 21 16:50:37.125977 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 107/221] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:36 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:37.214838 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:37.219754 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:37.221391 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:37.222298 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6eca6962-2546-4912-b1a2-ff3ad761e336 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:37.222572 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4ed4e445-191d-4c03-821c-baa5f9350479 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.175164 Jun 21 16:50:37.222886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6eca6962-2546-4912-b1a2-ff3ad761e336 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:37.225490 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 115/222] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:37 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:37.230123 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6eca6962-2546-4912-b1a2-ff3ad761e336 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:37.230570 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6eca6962-2546-4912-b1a2-ff3ad761e336 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:37.231375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6eca6962-2546-4912-b1a2-ff3ad761e336 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:37.231767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6eca6962-2546-4912-b1a2-ff3ad761e336 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:37.255614 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6eca6962-2546-4912-b1a2-ff3ad761e336 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/ips" status: 200 len: 145 microversion: 2.1 time: 0.038496 Jun 21 16:50:37.256436 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 108/223] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:50:37 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:50:37.841060 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-925e8f20-8042-461c-ae60-8c731ffea82b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:37.841731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-925e8f20-8042-461c-ae60-8c731ffea82b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:37.848739 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-925e8f20-8042-461c-ae60-8c731ffea82b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:37.849184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-925e8f20-8042-461c-ae60-8c731ffea82b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:37.849991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-925e8f20-8042-461c-ae60-8c731ffea82b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:37.850421 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-925e8f20-8042-461c-ae60-8c731ffea82b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:37.991103 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-925e8f20-8042-461c-ae60-8c731ffea82b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:38.001585 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-925e8f20-8042-461c-ae60-8c731ffea82b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.164427 Jun 21 16:50:38.003046 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 116/224] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:37 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:38.137784 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-263925be-50be-428d-bf19-f5fe42b38a7f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:38.138939 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-263925be-50be-428d-bf19-f5fe42b38a7f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:38.145132 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-263925be-50be-428d-bf19-f5fe42b38a7f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:38.145575 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-263925be-50be-428d-bf19-f5fe42b38a7f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:38.146400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-263925be-50be-428d-bf19-f5fe42b38a7f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:38.146825 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-263925be-50be-428d-bf19-f5fe42b38a7f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:38.242231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:38.243351 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:38.251078 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:38.254664 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:38.254664 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:38.254664 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:38.291165 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-263925be-50be-428d-bf19-f5fe42b38a7f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:38.299485 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-263925be-50be-428d-bf19-f5fe42b38a7f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.165427 Jun 21 16:50:38.300132 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 109/225] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:38 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:38.393331 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:38.401606 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:38.403114 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:38.404299 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-aea6369c-1587-4644-8fff-b0d910605076 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.166065 Jun 21 16:50:38.405912 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 117/226] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:38 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:50:39.019684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3624de9d-a0ec-4179-86e9-a42d80c9edde tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:39.020546 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3624de9d-a0ec-4179-86e9-a42d80c9edde tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:39.026774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3624de9d-a0ec-4179-86e9-a42d80c9edde tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:39.027243 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3624de9d-a0ec-4179-86e9-a42d80c9edde tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:39.028053 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3624de9d-a0ec-4179-86e9-a42d80c9edde tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:39.029113 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3624de9d-a0ec-4179-86e9-a42d80c9edde tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:39.172317 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3624de9d-a0ec-4179-86e9-a42d80c9edde tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:39.180159 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3624de9d-a0ec-4179-86e9-a42d80c9edde tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.165019 Jun 21 16:50:39.181064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 110/227] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:39 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:39.316631 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-318040c6-6156-475c-a4b8-276d85eb5891 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:39.317326 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-318040c6-6156-475c-a4b8-276d85eb5891 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:39.323812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-318040c6-6156-475c-a4b8-276d85eb5891 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:39.324254 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-318040c6-6156-475c-a4b8-276d85eb5891 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:39.325007 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-318040c6-6156-475c-a4b8-276d85eb5891 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:39.325479 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-318040c6-6156-475c-a4b8-276d85eb5891 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:39.424194 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:39.424796 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:39.431307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:39.431773 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:39.432521 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:39.433133 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:39.470639 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-318040c6-6156-475c-a4b8-276d85eb5891 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:39.474508 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:39.481894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-318040c6-6156-475c-a4b8-276d85eb5891 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.169031 Jun 21 16:50:39.493204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 118/228] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:39 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:39.585754 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:39.588113 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:39.594824 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:39.596318 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:39.597492 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ba71eacf-40dc-4295-870a-deeaeddf8886 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.178299 Jun 21 16:50:39.598051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 111/229] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:39 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:50:40.197598 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-28c97ef7-6c09-475c-b06b-703bf43a252b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:40.198203 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-28c97ef7-6c09-475c-b06b-703bf43a252b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:40.205514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-28c97ef7-6c09-475c-b06b-703bf43a252b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:40.205960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-28c97ef7-6c09-475c-b06b-703bf43a252b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:40.206709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-28c97ef7-6c09-475c-b06b-703bf43a252b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:40.207237 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-28c97ef7-6c09-475c-b06b-703bf43a252b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:40.499714 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a15aea38-b9cf-415b-9fdd-8910e960d26c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:40.500635 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a15aea38-b9cf-415b-9fdd-8910e960d26c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:40.507759 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a15aea38-b9cf-415b-9fdd-8910e960d26c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:40.508184 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a15aea38-b9cf-415b-9fdd-8910e960d26c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:40.508946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a15aea38-b9cf-415b-9fdd-8910e960d26c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:40.509404 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a15aea38-b9cf-415b-9fdd-8910e960d26c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:40.611783 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-28c97ef7-6c09-475c-b06b-703bf43a252b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:40.619317 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-28c97ef7-6c09-475c-b06b-703bf43a252b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.425568 Jun 21 16:50:40.630493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 119/230] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:40 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:40.635538 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:40.636134 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:40.637973 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=50 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:40.643834 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:40.644470 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:40.645304 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:40.645724 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:40.656692 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a15aea38-b9cf-415b-9fdd-8910e960d26c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:40.664365 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a15aea38-b9cf-415b-9fdd-8910e960d26c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.169086 Jun 21 16:50:40.664933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 112/231] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:40 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:40.777699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:40.786208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:40.787710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:40.788868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-aea8c3c8-bd63-4b90-8e1a-b745dfdbd073 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.157142 Jun 21 16:50:40.789457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 120/232] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:40 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:41.251016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-55732685-5f3d-42e1-bbf9-fd304b1875c2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41bedc3d-d823-4bcf-9dfb-067cedfe1999"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:41.252230 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-55732685-5f3d-42e1-bbf9-fd304b1875c2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:41.254827 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:41.258739 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=6 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:41.260747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55732685-5f3d-42e1-bbf9-fd304b1875c2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:41.261196 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55732685-5f3d-42e1-bbf9-fd304b1875c2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:41.262008 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55732685-5f3d-42e1-bbf9-fd304b1875c2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:41.262472 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55732685-5f3d-42e1-bbf9-fd304b1875c2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:41.637176 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-84d0ac96-5d8a-4227-bc91-18d6cf27923b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:41.637974 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-84d0ac96-5d8a-4227-bc91-18d6cf27923b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:41.645937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-84d0ac96-5d8a-4227-bc91-18d6cf27923b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:41.646341 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-84d0ac96-5d8a-4227-bc91-18d6cf27923b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:41.647172 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-84d0ac96-5d8a-4227-bc91-18d6cf27923b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:41.647602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-84d0ac96-5d8a-4227-bc91-18d6cf27923b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:41.785270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-84d0ac96-5d8a-4227-bc91-18d6cf27923b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:41.793348 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-84d0ac96-5d8a-4227-bc91-18d6cf27923b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.159937 Jun 21 16:50:41.793931 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 121/233] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:41 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:41.798678 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4fd09a0c-d011-468c-92c2-7a59d0a0397f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:41.799426 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4fd09a0c-d011-468c-92c2-7a59d0a0397f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:41.807822 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4fd09a0c-d011-468c-92c2-7a59d0a0397f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:41.808265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4fd09a0c-d011-468c-92c2-7a59d0a0397f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:41.809155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4fd09a0c-d011-468c-92c2-7a59d0a0397f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:41.809613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4fd09a0c-d011-468c-92c2-7a59d0a0397f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:41.948955 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4fd09a0c-d011-468c-92c2-7a59d0a0397f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:41.952926 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4fd09a0c-d011-468c-92c2-7a59d0a0397f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.157886 Jun 21 16:50:41.953700 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 122/234] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:41 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:41.959489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:41.960273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:41.970131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:41.970647 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:41.971480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:41.971916 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:42.073103 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-55732685-5f3d-42e1-bbf9-fd304b1875c2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827956 Jun 21 16:50:42.076572 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 113/235] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:50:41 2022] POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:50:42.114661 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:42.122221 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:42.124020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:42.125408 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9c17db2a-3a94-4d20-82b9-ee623e51a193 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.170337 Jun 21 16:50:42.129977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 123/236] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:41 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:42.814131 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ac488dfd-d682-4880-95ec-4ea7c6bcf166 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:42.815304 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ac488dfd-d682-4880-95ec-4ea7c6bcf166 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:42.822015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ac488dfd-d682-4880-95ec-4ea7c6bcf166 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:42.822461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ac488dfd-d682-4880-95ec-4ea7c6bcf166 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:42.823231 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ac488dfd-d682-4880-95ec-4ea7c6bcf166 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:42.823662 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ac488dfd-d682-4880-95ec-4ea7c6bcf166 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:42.863442 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-6d97683e-c343-4662-bc43-fa1914fbf408 req-fadd6f0e-de3e-462a-9797-d553cab78516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a79925a-5102-4509-af82-8a896c6037a6", "name": "network-vif-plugged", "status": "completed", "tag": "e727baaf-4a67-418e-bfc1-1564e9b5f9bf"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:42.863442 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=4 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:42.870609 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6d97683e-c343-4662-bc43-fa1914fbf408 req-fadd6f0e-de3e-462a-9797-d553cab78516 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:42.870609 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6d97683e-c343-4662-bc43-fa1914fbf408 req-fadd6f0e-de3e-462a-9797-d553cab78516 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:42.881711 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-6d97683e-c343-4662-bc43-fa1914fbf408 req-fadd6f0e-de3e-462a-9797-d553cab78516 service nova] Creating event network-vif-plugged:e727baaf-4a67-418e-bfc1-1564e9b5f9bf for instance 7a79925a-5102-4509-af82-8a896c6037a6 on hv-cinder-79987 Jun 21 16:50:42.887137 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-6d97683e-c343-4662-bc43-fa1914fbf408 req-fadd6f0e-de3e-462a-9797-d553cab78516 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041559 Jun 21 16:50:42.888268 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 124/237] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:50:42.974745 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ac488dfd-d682-4880-95ec-4ea7c6bcf166 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:42.978112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8d632520-baff-46b2-93d6-64d987bb5924 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:42.981731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8d632520-baff-46b2-93d6-64d987bb5924 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:42.988902 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ac488dfd-d682-4880-95ec-4ea7c6bcf166 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.180182 Jun 21 16:50:42.989897 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 114/238] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:42 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:43.000299 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8d632520-baff-46b2-93d6-64d987bb5924 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:43.001708 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8d632520-baff-46b2-93d6-64d987bb5924 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:43.003362 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8d632520-baff-46b2-93d6-64d987bb5924 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:43.004158 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8d632520-baff-46b2-93d6-64d987bb5924 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:43.148550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8d632520-baff-46b2-93d6-64d987bb5924 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:43.150467 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:43.155058 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:43.157204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8d632520-baff-46b2-93d6-64d987bb5924 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.189645 Jun 21 16:50:43.157872 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 125/239] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:42 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:43.162184 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:43.163037 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:43.163809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:43.164241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:43.511278 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:43.519773 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:43.521268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:43.522435 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f59a6d3f-e94a-4897-899d-47652504cf44 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.377976 Jun 21 16:50:43.522986 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 115/240] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:43 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:44.006252 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a77b3f52-0c87-4651-b7f1-9311405a1351 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:44.006852 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a77b3f52-0c87-4651-b7f1-9311405a1351 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:44.013353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a77b3f52-0c87-4651-b7f1-9311405a1351 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:44.013802 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a77b3f52-0c87-4651-b7f1-9311405a1351 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:44.014560 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a77b3f52-0c87-4651-b7f1-9311405a1351 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:44.014984 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a77b3f52-0c87-4651-b7f1-9311405a1351 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:44.146266 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a77b3f52-0c87-4651-b7f1-9311405a1351 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:44.153781 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a77b3f52-0c87-4651-b7f1-9311405a1351 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.151472 Jun 21 16:50:44.154350 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 126/241] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:44 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:44.173975 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2614e89f-82ab-498c-b02f-8a248141e8b9 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:44.174511 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2614e89f-82ab-498c-b02f-8a248141e8b9 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:44.180923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2614e89f-82ab-498c-b02f-8a248141e8b9 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:44.181409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2614e89f-82ab-498c-b02f-8a248141e8b9 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:44.182166 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2614e89f-82ab-498c-b02f-8a248141e8b9 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:44.182598 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2614e89f-82ab-498c-b02f-8a248141e8b9 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:44.317332 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2614e89f-82ab-498c-b02f-8a248141e8b9 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:44.324991 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2614e89f-82ab-498c-b02f-8a248141e8b9 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.154881 Jun 21 16:50:44.325678 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 116/242] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:44 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:44.541651 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:44.542252 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:44.549209 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:44.549678 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:44.550433 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:44.550861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:44.831550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:44.839596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:44.841103 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:44.842268 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4997fba0-5e76-4d6f-96c7-4482f1bea270 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.304523 Jun 21 16:50:44.842828 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 127/243] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:44 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:45.170953 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6a58916c-2c64-4515-88db-185da859f7c8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:45.171612 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6a58916c-2c64-4515-88db-185da859f7c8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:45.178127 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a58916c-2c64-4515-88db-185da859f7c8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:45.178741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a58916c-2c64-4515-88db-185da859f7c8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:45.179314 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a58916c-2c64-4515-88db-185da859f7c8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:45.179748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a58916c-2c64-4515-88db-185da859f7c8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:45.314347 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6a58916c-2c64-4515-88db-185da859f7c8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:45.322659 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6a58916c-2c64-4515-88db-185da859f7c8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.155602 Jun 21 16:50:45.323234 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 117/244] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:45 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:45.342519 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f0bac754-320d-4eeb-b3ee-228645eaede7 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:45.343119 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f0bac754-320d-4eeb-b3ee-228645eaede7 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:45.350131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f0bac754-320d-4eeb-b3ee-228645eaede7 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:45.350573 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f0bac754-320d-4eeb-b3ee-228645eaede7 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:45.351321 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f0bac754-320d-4eeb-b3ee-228645eaede7 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:45.351753 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f0bac754-320d-4eeb-b3ee-228645eaede7 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:45.484725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f0bac754-320d-4eeb-b3ee-228645eaede7 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:45.493267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f0bac754-320d-4eeb-b3ee-228645eaede7 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.154605 Jun 21 16:50:45.493851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 128/245] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:45 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:45.863058 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:45.863591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:45.869589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:45.870031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:45.870774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:45.871204 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:46.005690 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:46.013798 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:46.015972 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:46.016996 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c3d27338-6105-4f3c-a660-2ab99dd0fc76 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.158796 Jun 21 16:50:46.017632 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 118/246] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:45 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:46.344374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-91c4cc49-c303-4bb0-94da-e1681c8ffe63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:46.345027 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-91c4cc49-c303-4bb0-94da-e1681c8ffe63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:46.351507 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-91c4cc49-c303-4bb0-94da-e1681c8ffe63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:46.351956 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-91c4cc49-c303-4bb0-94da-e1681c8ffe63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:46.352751 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-91c4cc49-c303-4bb0-94da-e1681c8ffe63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:46.353189 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-91c4cc49-c303-4bb0-94da-e1681c8ffe63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:46.501226 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-91c4cc49-c303-4bb0-94da-e1681c8ffe63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:46.510113 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-91c4cc49-c303-4bb0-94da-e1681c8ffe63 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.170187 Jun 21 16:50:46.510657 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3f26a104-090e-47b2-a53e-ff1b16171559 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:46.511604 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3f26a104-090e-47b2-a53e-ff1b16171559 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:46.515091 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:46.519194 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3f26a104-090e-47b2-a53e-ff1b16171559 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:46.519712 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3f26a104-090e-47b2-a53e-ff1b16171559 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:46.519892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 129/247] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:46 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:46.520550 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3f26a104-090e-47b2-a53e-ff1b16171559 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:46.520974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3f26a104-090e-47b2-a53e-ff1b16171559 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:46.794839 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3f26a104-090e-47b2-a53e-ff1b16171559 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:46.803078 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3f26a104-090e-47b2-a53e-ff1b16171559 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.296160 Jun 21 16:50:46.803903 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 119/248] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:46 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:47.036211 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:47.037034 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:47.043338 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:47.044583 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:47.046593 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:47.046593 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:47.190648 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:47.199775 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:47.201438 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:47.202674 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e7f04885-f226-4f3c-b651-5259f1e08896 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.171289 Jun 21 16:50:47.204103 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 130/249] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:47 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:47.527079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ee296f83-dc6f-4d57-b862-f7dfa4186bfa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:47.527680 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ee296f83-dc6f-4d57-b862-f7dfa4186bfa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:47.534170 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ee296f83-dc6f-4d57-b862-f7dfa4186bfa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:47.534611 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ee296f83-dc6f-4d57-b862-f7dfa4186bfa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:47.535364 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ee296f83-dc6f-4d57-b862-f7dfa4186bfa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:47.535796 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ee296f83-dc6f-4d57-b862-f7dfa4186bfa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:47.670338 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ee296f83-dc6f-4d57-b862-f7dfa4186bfa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:47.678528 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ee296f83-dc6f-4d57-b862-f7dfa4186bfa tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.155250 Jun 21 16:50:47.679093 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 120/250] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:47 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:47.820192 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-99538891-c942-4991-8205-5dcbd145d7a1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:47.820772 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-99538891-c942-4991-8205-5dcbd145d7a1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:47.827255 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99538891-c942-4991-8205-5dcbd145d7a1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:47.827685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99538891-c942-4991-8205-5dcbd145d7a1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:47.829039 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99538891-c942-4991-8205-5dcbd145d7a1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:47.829505 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99538891-c942-4991-8205-5dcbd145d7a1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:47.959641 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-99538891-c942-4991-8205-5dcbd145d7a1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:47.968415 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-99538891-c942-4991-8205-5dcbd145d7a1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1314 microversion: 2.1 time: 0.152119 Jun 21 16:50:47.970749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 131/251] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:47 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:48.222224 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:48.222830 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:48.228810 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:48.232205 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:48.232205 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:48.232205 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:48.362002 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:48.369807 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:48.371294 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:48.372442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-202c7001-f96d-4bd4-9588-0a3bb7227632 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.154971 Jun 21 16:50:48.372972 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 121/252] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:48 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:48.695270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f59cf842-201c-4963-aa82-4170313edfb2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:48.695940 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f59cf842-201c-4963-aa82-4170313edfb2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:48.702227 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f59cf842-201c-4963-aa82-4170313edfb2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:48.704470 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f59cf842-201c-4963-aa82-4170313edfb2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:48.704470 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f59cf842-201c-4963-aa82-4170313edfb2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:48.704848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f59cf842-201c-4963-aa82-4170313edfb2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:48.841160 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f59cf842-201c-4963-aa82-4170313edfb2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:48.848996 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f59cf842-201c-4963-aa82-4170313edfb2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.157644 Jun 21 16:50:48.851845 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 132/253] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:48 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:48.987154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-53675db2-fd15-4352-a8ad-2b4c0e7188c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:48.987682 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-53675db2-fd15-4352-a8ad-2b4c0e7188c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:48.994169 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-53675db2-fd15-4352-a8ad-2b4c0e7188c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:48.994617 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-53675db2-fd15-4352-a8ad-2b4c0e7188c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:48.995373 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-53675db2-fd15-4352-a8ad-2b4c0e7188c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:48.995808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-53675db2-fd15-4352-a8ad-2b4c0e7188c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:49.128469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-53675db2-fd15-4352-a8ad-2b4c0e7188c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:49.135970 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-53675db2-fd15-4352-a8ad-2b4c0e7188c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1498 microversion: 2.1 time: 0.153433 Jun 21 16:50:49.136571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 122/254] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:48 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:49.390664 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:49.391304 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:49.397326 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:49.397776 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:49.398538 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:49.398970 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:49.534120 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:49.542372 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:49.543898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:49.545042 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fccc447b-4c85-4409-9494-42b7c971f0f7 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.158334 Jun 21 16:50:49.545638 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 133/255] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:49 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:49.866725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bd4ffa2a-8fad-48a5-976d-90ba3cf3b647 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:49.867326 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bd4ffa2a-8fad-48a5-976d-90ba3cf3b647 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:49.874136 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bd4ffa2a-8fad-48a5-976d-90ba3cf3b647 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:49.874488 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bd4ffa2a-8fad-48a5-976d-90ba3cf3b647 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:49.875327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bd4ffa2a-8fad-48a5-976d-90ba3cf3b647 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:49.876124 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bd4ffa2a-8fad-48a5-976d-90ba3cf3b647 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:50.013589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bd4ffa2a-8fad-48a5-976d-90ba3cf3b647 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:50.021843 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bd4ffa2a-8fad-48a5-976d-90ba3cf3b647 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.158705 Jun 21 16:50:50.022417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 123/256] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:49 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:50.343145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e9b61f45-fcfe-4452-b470-67739980390c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:50.343605 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e9b61f45-fcfe-4452-b470-67739980390c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:50.350602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e9b61f45-fcfe-4452-b470-67739980390c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:50.351046 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e9b61f45-fcfe-4452-b470-67739980390c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:50.351812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e9b61f45-fcfe-4452-b470-67739980390c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:50.352272 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e9b61f45-fcfe-4452-b470-67739980390c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:50.379616 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e9b61f45-fcfe-4452-b470-67739980390c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Going to try to terminate instance {{(pid=124685) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:50:50.484346 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:50.564934 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:50.565728 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:50.571884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:50.579658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:50.579658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:50.579658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:50.723626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e9b61f45-fcfe-4452-b470-67739980390c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 204 len: 0 microversion: 2.1 time: 0.383549 Jun 21 16:50:50.724534 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 134/257] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:50:50 2022] DELETE /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:50:50.733251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-38eafd71-6f39-415c-95ce-73c4b4562c22 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:50.733965 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-38eafd71-6f39-415c-95ce-73c4b4562c22 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:50.740742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-38eafd71-6f39-415c-95ce-73c4b4562c22 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:50.741190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-38eafd71-6f39-415c-95ce-73c4b4562c22 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:50.741990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-38eafd71-6f39-415c-95ce-73c4b4562c22 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:50.742420 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-38eafd71-6f39-415c-95ce-73c4b4562c22 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:50.767112 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:50.787098 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:50.789948 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:50.789948 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-69f690dc-2a06-4004-a412-4e08dae3b934 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.229780 Jun 21 16:50:50.790670 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 124/258] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:50 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:50:50.880410 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-38eafd71-6f39-415c-95ce-73c4b4562c22 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:50.894373 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-38eafd71-6f39-415c-95ce-73c4b4562c22 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1504 microversion: 2.1 time: 0.159701 Jun 21 16:50:50.894373 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 135/259] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:50 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:51.040549 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-25b38b83-f367-4433-88e4-621906ac8412 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:51.041178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-25b38b83-f367-4433-88e4-621906ac8412 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:51.048811 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25b38b83-f367-4433-88e4-621906ac8412 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.049306 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25b38b83-f367-4433-88e4-621906ac8412 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.050255 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25b38b83-f367-4433-88e4-621906ac8412 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.050698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25b38b83-f367-4433-88e4-621906ac8412 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.208106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-25b38b83-f367-4433-88e4-621906ac8412 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:51.216087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-25b38b83-f367-4433-88e4-621906ac8412 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1503 microversion: 2.1 time: 0.180732 Jun 21 16:50:51.216764 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 125/260] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:51 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:51.234481 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5ec75aa-7bf4-488e-96bd-86d60034073c"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:51.235630 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:51.241788 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.242496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.242982 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.243412 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.267710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] HTTP exception thrown: Cannot 'attach_volume' instance b12e3b57-72af-4292-ba65-d90c166a49ed while it is in vm_state rescued Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Request method failure captured: Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: POST /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed/os-volume_attachments HTTP/1.1 Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 74 Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZn0mLuiXkothFA1iTZfSS5-_yLF0j6HitWawZCjgPGkA4OJxaSwSMT8mhFcZQGSPNw6xFR5WXxVCDVyimcJcr7TMO8KVpEXQe3RxCCLfR3ByFHqAWxQqI7UdhzT5l5J03QmKYOc-Sc6N3m_t-ei_BPoa2fHkg0tYS-JvarrnosSjI Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:50:51.269764 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_25beca9acf4f4420b1a2dc0ec397847e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: f45384380b364e60823101515b359ba6 Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {"volumeAttachment": {"volumeId": "f5ec75aa-7bf4-488e-96bd-86d60034073c"}} Jun 21 16:50:51.271407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Cannot 'attach_volume' instance b12e3b57-72af-4292-ba65-d90c166a49ed while it is in vm_state rescued Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'server_id': 'b12e3b57-72af-4292-ba65-d90c166a49ed', 'body': {'volumeAttachment': {'volumeId': 'f5ec75aa-7bf4-488e-96bd-86d60034073c'}}} Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b12e3b57-72af-4292-ba65-d90c166a49ed in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:50:51.272314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b12e3b57-72af-4292-ba65-d90c166a49ed while it is in vm_state rescued Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:50:51.277660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:50:51.279624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:50:51.279624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:50:51.279624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b12e3b57-72af-4292-ba65-d90c166a49ed while it is in vm_state rescued Jun 21 16:50:51.279624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:50:51.279624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Returning 409 to user: Cannot 'attach_volume' instance b12e3b57-72af-4292-ba65-d90c166a49ed while it is in vm_state rescued {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:50:51.279624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-189b8d8d-5d20-46dc-85fd-cb133d88df1d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041764 Jun 21 16:50:51.279624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 136/261] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:50:51 2022] POST /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 16:50:51.282493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cc38b0ba-b99c-4ad3-afa9-b3dd35caa178 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:51.283664 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cc38b0ba-b99c-4ad3-afa9-b3dd35caa178 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:51.290030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc38b0ba-b99c-4ad3-afa9-b3dd35caa178 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.290492 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc38b0ba-b99c-4ad3-afa9-b3dd35caa178 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.291249 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc38b0ba-b99c-4ad3-afa9-b3dd35caa178 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.291686 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc38b0ba-b99c-4ad3-afa9-b3dd35caa178 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.331470 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:50:51.530762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cc38b0ba-b99c-4ad3-afa9-b3dd35caa178 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed/action" status: 202 len: 0 microversion: 2.1 time: 0.251927 Jun 21 16:50:51.531705 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 126/262] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:50:51 2022] POST /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:50:51.541647 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-33b66f2e-9d7a-48be-989d-c666f6b5b4d5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:51.542354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-33b66f2e-9d7a-48be-989d-c666f6b5b4d5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:51.550704 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-33b66f2e-9d7a-48be-989d-c666f6b5b4d5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.551152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-33b66f2e-9d7a-48be-989d-c666f6b5b4d5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.551971 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-33b66f2e-9d7a-48be-989d-c666f6b5b4d5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.552325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-33b66f2e-9d7a-48be-989d-c666f6b5b4d5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.702740 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-33b66f2e-9d7a-48be-989d-c666f6b5b4d5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:51.711398 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-33b66f2e-9d7a-48be-989d-c666f6b5b4d5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1511 microversion: 2.1 time: 0.173746 Jun 21 16:50:51.712146 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 137/263] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:51 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:51.809407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:51.810104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:51.817174 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.817721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.818733 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.819172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.911624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c5f9ce3e-3463-4ba4-88ac-2fd9b35ca312 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:51.912504 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c5f9ce3e-3463-4ba4-88ac-2fd9b35ca312 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:51.918938 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5f9ce3e-3463-4ba4-88ac-2fd9b35ca312 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.920157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5f9ce3e-3463-4ba4-88ac-2fd9b35ca312 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:51.921110 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5f9ce3e-3463-4ba4-88ac-2fd9b35ca312 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:51.922030 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5f9ce3e-3463-4ba4-88ac-2fd9b35ca312 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:52.021932 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:52.030895 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:52.033616 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:52.035109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b155ad4f-d54f-43c1-b5a2-36ce4ffb0771 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.229969 Jun 21 16:50:52.035682 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 127/264] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:51 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:52.078345 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c5f9ce3e-3463-4ba4-88ac-2fd9b35ca312 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:52.085634 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c5f9ce3e-3463-4ba4-88ac-2fd9b35ca312 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1504 microversion: 2.1 time: 0.179443 Jun 21 16:50:52.086329 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 138/265] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:51 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:52.729338 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-74cf355a-3826-488e-9ab6-50096242ad5b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:52.730056 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-74cf355a-3826-488e-9ab6-50096242ad5b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:52.738577 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-74cf355a-3826-488e-9ab6-50096242ad5b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:52.739156 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-74cf355a-3826-488e-9ab6-50096242ad5b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:52.740218 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-74cf355a-3826-488e-9ab6-50096242ad5b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:52.740862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-74cf355a-3826-488e-9ab6-50096242ad5b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:52.884203 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-74cf355a-3826-488e-9ab6-50096242ad5b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:52.892362 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-74cf355a-3826-488e-9ab6-50096242ad5b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1511 microversion: 2.1 time: 0.167951 Jun 21 16:50:52.892884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 128/266] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:52 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:53.055780 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:53.056420 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:53.063917 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:53.064380 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:53.069447 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:53.069447 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:53.102897 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2fee1ae1-6c5b-49cc-87f5-1f9348e7bc51 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:53.103576 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2fee1ae1-6c5b-49cc-87f5-1f9348e7bc51 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:53.110661 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2fee1ae1-6c5b-49cc-87f5-1f9348e7bc51 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:53.111343 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2fee1ae1-6c5b-49cc-87f5-1f9348e7bc51 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:53.112327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2fee1ae1-6c5b-49cc-87f5-1f9348e7bc51 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:53.112765 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2fee1ae1-6c5b-49cc-87f5-1f9348e7bc51 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:53.203353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:53.212241 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:53.213712 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:53.217164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4c285e90-1861-40ea-96c1-d15921ac8181 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.163156 Jun 21 16:50:53.217164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 139/267] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:53 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:53.256267 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2fee1ae1-6c5b-49cc-87f5-1f9348e7bc51 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:53.274179 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2fee1ae1-6c5b-49cc-87f5-1f9348e7bc51 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1504 microversion: 2.1 time: 0.174896 Jun 21 16:50:53.274649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 129/268] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:53 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:53.909397 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-773cee80-0868-4b28-ac36-bfc61cc44a0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:53.910004 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-773cee80-0868-4b28-ac36-bfc61cc44a0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:53.916016 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-773cee80-0868-4b28-ac36-bfc61cc44a0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:53.916464 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-773cee80-0868-4b28-ac36-bfc61cc44a0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:53.917239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-773cee80-0868-4b28-ac36-bfc61cc44a0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:53.917709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-773cee80-0868-4b28-ac36-bfc61cc44a0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:54.050631 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-773cee80-0868-4b28-ac36-bfc61cc44a0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:54.058878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-773cee80-0868-4b28-ac36-bfc61cc44a0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1511 microversion: 2.1 time: 0.153131 Jun 21 16:50:54.059489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 140/269] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:53 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:54.234301 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:54.235477 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:54.242376 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:54.242896 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:54.243749 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:54.244179 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:54.291699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-402e9f46-7139-42d5-8df6-72f154e3ead6 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:54.292676 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-402e9f46-7139-42d5-8df6-72f154e3ead6 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:54.299851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-402e9f46-7139-42d5-8df6-72f154e3ead6 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:54.300475 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-402e9f46-7139-42d5-8df6-72f154e3ead6 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:54.301442 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-402e9f46-7139-42d5-8df6-72f154e3ead6 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:54.302016 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-402e9f46-7139-42d5-8df6-72f154e3ead6 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:54.385594 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:54.394993 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:54.396757 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:54.398178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0202d02f-fb72-42b7-a073-f8bd5711d3e3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.167880 Jun 21 16:50:54.409697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 130/270] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:54 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:54.440182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-402e9f46-7139-42d5-8df6-72f154e3ead6 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:54.448099 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-402e9f46-7139-42d5-8df6-72f154e3ead6 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1504 microversion: 2.1 time: 0.160159 Jun 21 16:50:54.448736 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 141/271] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:54 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:55.078614 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bfc67e04-ebbc-412f-89c3-36b50bfdf0df tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:55.080063 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bfc67e04-ebbc-412f-89c3-36b50bfdf0df tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:55.086865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfc67e04-ebbc-412f-89c3-36b50bfdf0df tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:55.087548 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfc67e04-ebbc-412f-89c3-36b50bfdf0df tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:55.088310 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfc67e04-ebbc-412f-89c3-36b50bfdf0df tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:55.088914 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfc67e04-ebbc-412f-89c3-36b50bfdf0df tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:55.281477 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bfc67e04-ebbc-412f-89c3-36b50bfdf0df tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:55.289348 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bfc67e04-ebbc-412f-89c3-36b50bfdf0df tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1511 microversion: 2.1 time: 0.216086 Jun 21 16:50:55.289982 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 131/272] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:55 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:55.417259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:55.417920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:55.424436 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:55.424881 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:55.425676 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:55.426124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:55.464946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-77f40165-3f24-4e42-97bd-f6ba6925a194 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:55.465580 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-77f40165-3f24-4e42-97bd-f6ba6925a194 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:55.472630 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-77f40165-3f24-4e42-97bd-f6ba6925a194 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:55.473070 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-77f40165-3f24-4e42-97bd-f6ba6925a194 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:55.473861 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-77f40165-3f24-4e42-97bd-f6ba6925a194 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:55.474278 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-77f40165-3f24-4e42-97bd-f6ba6925a194 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:55.564318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:55.573048 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:55.574599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:55.575750 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-11fe2fd2-077d-499c-9952-e083dc35a4e0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.162498 Jun 21 16:50:55.576360 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 142/273] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:55 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:55.773215 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-77f40165-3f24-4e42-97bd-f6ba6925a194 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:55.780621 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-77f40165-3f24-4e42-97bd-f6ba6925a194 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1504 microversion: 2.1 time: 0.319525 Jun 21 16:50:55.787909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 132/274] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:55 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:56.233610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-b47e636c-3d83-430f-a9bb-2fc70f36a503 req-6e764410-008b-4f7e-9221-05e5a2dd8ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a79925a-5102-4509-af82-8a896c6037a6", "name": "network-vif-deleted", "tag": "e727baaf-4a67-418e-bfc1-1564e9b5f9bf"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:56.242016 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-b47e636c-3d83-430f-a9bb-2fc70f36a503 req-6e764410-008b-4f7e-9221-05e5a2dd8ba4 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:56.242464 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-b47e636c-3d83-430f-a9bb-2fc70f36a503 req-6e764410-008b-4f7e-9221-05e5a2dd8ba4 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:56.254418 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-b47e636c-3d83-430f-a9bb-2fc70f36a503 req-6e764410-008b-4f7e-9221-05e5a2dd8ba4 service nova] Creating event network-vif-deleted:e727baaf-4a67-418e-bfc1-1564e9b5f9bf for instance 7a79925a-5102-4509-af82-8a896c6037a6 on hv-cinder-79987 Jun 21 16:50:56.259511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-b47e636c-3d83-430f-a9bb-2fc70f36a503 req-6e764410-008b-4f7e-9221-05e5a2dd8ba4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029860 Jun 21 16:50:56.260179 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 143/275] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:50:56.306884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9a493583-3268-43b3-89f7-c81445a857f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:56.307587 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9a493583-3268-43b3-89f7-c81445a857f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:56.314878 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9a493583-3268-43b3-89f7-c81445a857f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:56.315325 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9a493583-3268-43b3-89f7-c81445a857f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:56.316351 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9a493583-3268-43b3-89f7-c81445a857f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:56.316790 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9a493583-3268-43b3-89f7-c81445a857f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:56.549195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9a493583-3268-43b3-89f7-c81445a857f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:56.556858 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9a493583-3268-43b3-89f7-c81445a857f9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1511 microversion: 2.1 time: 0.254495 Jun 21 16:50:56.557547 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 133/276] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:56 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:56.597996 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:56.599589 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:56.608465 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:56.608926 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:56.609722 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:56.610160 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:56.754249 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:56.763315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:56.765058 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:56.766243 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-31bee96e-53b0-45f7-a00c-4919e3cc264b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.175136 Jun 21 16:50:56.766808 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 144/277] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:56 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:56.798603 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:56.799248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:56.805330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:56.805804 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:56.806558 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:56.806985 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:56.836781 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:56.837255 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:56.837731 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lazy-loading 'fault' on Instance uuid 7a79925a-5102-4509-af82-8a896c6037a6 {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:50:56.884393 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:56.892060 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6a389020-e52f-44ab-9a6d-e1f5c2f7ac9b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1304 microversion: 2.1 time: 0.098013 Jun 21 16:50:56.892662 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 134/278] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:56 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:57.311525 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3640ba1a-73d6-42f3-baf9-bd213b0e6560 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:57.321388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3640ba1a-73d6-42f3-baf9-bd213b0e6560 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:57.321388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3640ba1a-73d6-42f3-baf9-bd213b0e6560 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:57.386982 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3640ba1a-73d6-42f3-baf9-bd213b0e6560 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Going to try to stop instance {{(pid=124685) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 16:50:57.574709 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a9c59d04-b3a4-4b7b-ba62-66c1ecf691cc tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:57.575317 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a9c59d04-b3a4-4b7b-ba62-66c1ecf691cc tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:57.582635 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a9c59d04-b3a4-4b7b-ba62-66c1ecf691cc tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:57.583086 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a9c59d04-b3a4-4b7b-ba62-66c1ecf691cc tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:57.583843 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a9c59d04-b3a4-4b7b-ba62-66c1ecf691cc tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:57.584275 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a9c59d04-b3a4-4b7b-ba62-66c1ecf691cc tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:57.711904 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a9c59d04-b3a4-4b7b-ba62-66c1ecf691cc tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:57.719533 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a9c59d04-b3a4-4b7b-ba62-66c1ecf691cc tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1511 microversion: 2.1 time: 0.148656 Jun 21 16:50:57.720271 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 135/279] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:57 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:57.785105 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:57.785828 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:57.792214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:57.792664 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:57.793476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:57.793915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:57.936927 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:57.951985 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:57.953556 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:57.954761 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f25d69d7-2bbb-4959-87e8-8472bafe0187 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.173568 Jun 21 16:50:57.955517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 136/280] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:57 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:50:57.966089 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:57.966721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:57.978201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3640ba1a-73d6-42f3-baf9-bd213b0e6560 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/action" status: 202 len: 0 microversion: 2.1 time: 0.669868 Jun 21 16:50:57.984216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:57.984216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:57.984216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:57.984526 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 145/281] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:50:57 2022] POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:50:57.984617 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:57.993959 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5326853f-e7c4-43e3-8e68-76f80c0835b2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:57.995619 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5326853f-e7c4-43e3-8e68-76f80c0835b2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:58.004424 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5326853f-e7c4-43e3-8e68-76f80c0835b2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:58.004937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5326853f-e7c4-43e3-8e68-76f80c0835b2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:58.005817 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5326853f-e7c4-43e3-8e68-76f80c0835b2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:58.006301 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5326853f-e7c4-43e3-8e68-76f80c0835b2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:58.028985 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:58.036053 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:58.036538 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lazy-loading 'fault' on Instance uuid 7a79925a-5102-4509-af82-8a896c6037a6 {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:50:58.093562 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:58.101555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-78669c44-37eb-46ae-adc1-58004497db1c tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 200 len: 1304 microversion: 2.1 time: 0.139221 Jun 21 16:50:58.102377 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 137/282] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:57 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:58.166710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-5326853f-e7c4-43e3-8e68-76f80c0835b2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:58.178890 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5326853f-e7c4-43e3-8e68-76f80c0835b2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.190387 Jun 21 16:50:58.179086 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 146/283] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:57 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:50:58.741359 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bad8fc78-2ade-4571-ad9b-eeced34bbc59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:58.742473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bad8fc78-2ade-4571-ad9b-eeced34bbc59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:58.753881 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bad8fc78-2ade-4571-ad9b-eeced34bbc59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:58.754720 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bad8fc78-2ade-4571-ad9b-eeced34bbc59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:58.756107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bad8fc78-2ade-4571-ad9b-eeced34bbc59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:58.756916 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bad8fc78-2ade-4571-ad9b-eeced34bbc59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:58.911543 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bad8fc78-2ade-4571-ad9b-eeced34bbc59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:58.918950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bad8fc78-2ade-4571-ad9b-eeced34bbc59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1517 microversion: 2.1 time: 0.185139 Jun 21 16:50:58.919583 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 138/284] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:58 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:58.974077 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:58.987124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:58.987124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:58.987124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:58.987124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:58.988135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:59.120068 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:59.120236 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:59.120674 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 7a79925a-5102-4509-af82-8a896c6037a6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:59.127516 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:59.127966 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:59.128482 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:59.128724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:59.129371 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:59.130133 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:59.131517 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1dd65479-7d70-4406-941c-b04ba274907f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.162842 Jun 21 16:50:59.141450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 147/285] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:50:58 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:50:59.144756 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] HTTP exception thrown: Instance 7a79925a-5102-4509-af82-8a896c6037a6 could not be found. Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Request method failure captured: Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 HTTP/1.1 Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfbRG-tTpUhiQQy4YfuMfFz3WJ4-nh29e8b3fJ_NjxyUFP5gTUIyThv719c4pIv_RExUIUAvEu4115CtMSSBx-oIGbixIPeKOM3AZZWWosYdh7ISI3v2E1FmJcYOE9Oz1c4H9hj4lI7CLoPJw22nimhh1kvPqvxDH_vyTDGA2KpMnvM Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 83fb026ffcbd4a71929a4b3c860b3bee Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-VolumesActionsTest-1528341730 Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:50:59.149741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83fb026ffcbd4a71929a4b3c860b3bee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/83fb026ffcbd4a71929a4b3c860b3bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83fb026ffcbd4a71929a4b3c860b3bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_83fb026ffcbd4a71929a4b3c860b3bee", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-VolumesActionsTest-1528341730 Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 83fb026ffcbd4a71929a4b3c860b3bee Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-VolumesActionsTest-1528341730 Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-VolumesActionsTest-1528341730-project Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 127c04cf84664a7582853dec90f130b6 Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-VolumesActionsTest-1528341730-project Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 7a79925a-5102-4509-af82-8a896c6037a6 could not be found. Jun 21 16:50:59.151268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '7a79925a-5102-4509-af82-8a896c6037a6'} Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a79925a-5102-4509-af82-8a896c6037a6 could not be found. Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:50:59.152079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a79925a-5102-4509-af82-8a896c6037a6 could not be found. Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a79925a-5102-4509-af82-8a896c6037a6 could not be found. Jun 21 16:50:59.153254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:50:59.154487 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Returning 404 to user: Instance 7a79925a-5102-4509-af82-8a896c6037a6 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:50:59.154487 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8e8c5d09-c508-411d-a56b-c547ee560d2e tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6" status: 404 len: 111 microversion: 2.1 time: 0.032669 Jun 21 16:50:59.154487 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 139/286] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:59 2022] GET /compute/v2.1/servers/7a79925a-5102-4509-af82-8a896c6037a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:50:59.197725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ba14f168-f253-4bdd-84d7-833c630fb7c3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:59.198384 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ba14f168-f253-4bdd-84d7-833c630fb7c3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:50:59.204687 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ba14f168-f253-4bdd-84d7-833c630fb7c3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:59.205325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ba14f168-f253-4bdd-84d7-833c630fb7c3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:59.205901 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ba14f168-f253-4bdd-84d7-833c630fb7c3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:59.206339 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ba14f168-f253-4bdd-84d7-833c630fb7c3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:59.256292 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-682040461", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "networks": [{"uuid": "5cf6e549-6d0a-4c00-bdfa-de021fc82834"}]}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:50:59.316437 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.network.neutron [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] validate_networks() for [('5cf6e549-6d0a-4c00-bdfa-de021fc82834', None, None, None, None, None)] {{(pid=124686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:50:59.354069 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ba14f168-f253-4bdd-84d7-833c630fb7c3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:50:59.363360 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ba14f168-f253-4bdd-84d7-833c630fb7c3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.169641 Jun 21 16:50:59.364194 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 148/287] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:59 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:50:59.728961 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Flavor limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:50:59.729867 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Image limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:50:59.730445 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Flavor pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:50:59.731202 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Image pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:50:59.731682 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:50:59.745097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:59.746356 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:59.747238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:50:59.747739 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:50:59.770442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Getting quotas for project 83fb026ffcbd4a71929a4b3c860b3bee. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:50:59.774894 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Getting quotas for user 127c04cf84664a7582853dec90f130b6 and project 83fb026ffcbd4a71929a4b3c860b3bee. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:50:59.787164 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Going to run 1 instances... {{(pid=124686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:50:59.789748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:50:59.983973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d677cc04-eb0f-4a9d-97cf-c60b41dc5df2 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732244 Jun 21 16:50:59.985469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 140/288] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 16:50:59.996238 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-eec9d10b-3e5f-47d5-8e6d-9f622d747526 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:50:59.997468 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-eec9d10b-3e5f-47d5-8e6d-9f622d747526 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:00.060631 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-eec9d10b-3e5f-47d5-8e6d-9f622d747526 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:00.068201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-eec9d10b-3e5f-47d5-8e6d-9f622d747526 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1213 microversion: 2.1 time: 0.075950 Jun 21 16:51:00.068791 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 149/289] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:50:59 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:00.151393 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:00.152007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:00.160921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:00.164097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:00.164097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:00.164097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:00.301120 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:00.309076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:00.310625 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:00.311781 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a8dc2a08-46d4-46d3-ba6e-9c912c2b395f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1744 microversion: 2.20 time: 0.165299 Jun 21 16:51:00.312334 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 141/290] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:00 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:00.384062 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e7f4e90c-a722-46ba-b4d7-0f850c90e286 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:00.386350 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e7f4e90c-a722-46ba-b4d7-0f850c90e286 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:00.391294 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7f4e90c-a722-46ba-b4d7-0f850c90e286 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:00.391837 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7f4e90c-a722-46ba-b4d7-0f850c90e286 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:00.392788 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7f4e90c-a722-46ba-b4d7-0f850c90e286 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:00.393511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7f4e90c-a722-46ba-b4d7-0f850c90e286 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:00.545701 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e7f4e90c-a722-46ba-b4d7-0f850c90e286 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:00.552325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e7f4e90c-a722-46ba-b4d7-0f850c90e286 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.174313 Jun 21 16:51:00.552899 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 150/291] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:00 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:00.684753 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-09e48234-b274-46ed-9417-5c38eb090532 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'create', calling method: .version_select at 0x7f0a42f58280>, body: {"keypair": {"name": "tempest-keypair-1912144253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdkE5bY1BtA4/nNSWGGB4wi6QF93fTfcD5d5jQr+bi3zX3L6lUUStVXN+rsX82OAf4N5rF5qiTVVWqk9QpJdnSyHUkqCdj/OcWhDYKmQ9Id7JzdndXBuXhTDwo9ApPmbA=="}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:00.698880 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-09e48234-b274-46ed-9417-5c38eb090532 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Getting quotas for project 25beca9acf4f4420b1a2dc0ec397847e. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:51:00.702660 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-09e48234-b274-46ed-9417-5c38eb090532 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Getting quotas for user f45384380b364e60823101515b359ba6 and project 25beca9acf4f4420b1a2dc0ec397847e. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:51:01.067067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-09e48234-b274-46ed-9417-5c38eb090532 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.386158 Jun 21 16:51:01.067778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 142/292] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 16:51:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:51:01.086556 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0bf70d8a-6a8a-426b-8b96-a5f4668fa7c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:01.093756 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0bf70d8a-6a8a-426b-8b96-a5f4668fa7c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:01.094521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0bf70d8a-6a8a-426b-8b96-a5f4668fa7c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:01.094975 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0bf70d8a-6a8a-426b-8b96-a5f4668fa7c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:01.096571 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0bf70d8a-6a8a-426b-8b96-a5f4668fa7c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:01.096951 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0bf70d8a-6a8a-426b-8b96-a5f4668fa7c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:01.164070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0bf70d8a-6a8a-426b-8b96-a5f4668fa7c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:01.171925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0bf70d8a-6a8a-426b-8b96-a5f4668fa7c8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1217 microversion: 2.1 time: 0.089846 Jun 21 16:51:01.172493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 151/293] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:01 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:01.336252 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:01.336814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:01.342787 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:01.343232 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:01.344037 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:01.344815 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:01.486936 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:01.494882 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:01.496508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:01.497894 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-325100c7-9c20-49ff-92bf-a6210a64b81c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1744 microversion: 2.20 time: 0.165729 Jun 21 16:51:01.498443 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 143/294] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:01 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:01.569916 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ff386c12-fe0d-4e69-b73b-2033cc704631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:01.570514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ff386c12-fe0d-4e69-b73b-2033cc704631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:01.576642 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ff386c12-fe0d-4e69-b73b-2033cc704631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:01.577085 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ff386c12-fe0d-4e69-b73b-2033cc704631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:01.577970 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ff386c12-fe0d-4e69-b73b-2033cc704631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:01.578471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ff386c12-fe0d-4e69-b73b-2033cc704631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:01.584090 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:01.758255 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ff386c12-fe0d-4e69-b73b-2033cc704631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:01.766403 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ff386c12-fe0d-4e69-b73b-2033cc704631 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.200399 Jun 21 16:51:01.766969 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 152/295] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:01 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:02.190671 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b3299597-cbf9-4780-805b-d4529ca49833 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:02.191283 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b3299597-cbf9-4780-805b-d4529ca49833 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:02.198037 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3299597-cbf9-4780-805b-d4529ca49833 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:02.198574 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3299597-cbf9-4780-805b-d4529ca49833 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:02.199409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3299597-cbf9-4780-805b-d4529ca49833 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:02.199918 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3299597-cbf9-4780-805b-d4529ca49833 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:02.215484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:02.261746 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b3299597-cbf9-4780-805b-d4529ca49833 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:02.270071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b3299597-cbf9-4780-805b-d4529ca49833 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1209 microversion: 2.1 time: 0.084060 Jun 21 16:51:02.270649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 144/296] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:02 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:02.518700 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:02.519800 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:02.527642 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:02.528276 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:02.529208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:02.529828 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:02.726925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:02.735253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:02.738004 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:02.739223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-eb847278-0f6d-48e2-91ae-629acf44ba1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1744 microversion: 2.20 time: 0.224913 Jun 21 16:51:02.739843 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 153/297] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:02 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:02.794913 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-124d1595-a697-4d12-97a8-27d89c2f4b0e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:02.795635 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-124d1595-a697-4d12-97a8-27d89c2f4b0e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:02.803319 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-124d1595-a697-4d12-97a8-27d89c2f4b0e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:02.803893 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-124d1595-a697-4d12-97a8-27d89c2f4b0e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:02.804652 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-124d1595-a697-4d12-97a8-27d89c2f4b0e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:02.805074 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-124d1595-a697-4d12-97a8-27d89c2f4b0e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:02.942655 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-124d1595-a697-4d12-97a8-27d89c2f4b0e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:02.950762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-124d1595-a697-4d12-97a8-27d89c2f4b0e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.160144 Jun 21 16:51:02.951418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 145/298] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:02 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:03.288381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e88175cd-c962-4b46-80a0-8c11703d34b4 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:03.289000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e88175cd-c962-4b46-80a0-8c11703d34b4 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:03.295055 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e88175cd-c962-4b46-80a0-8c11703d34b4 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:03.295502 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e88175cd-c962-4b46-80a0-8c11703d34b4 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:03.296281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e88175cd-c962-4b46-80a0-8c11703d34b4 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:03.296713 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e88175cd-c962-4b46-80a0-8c11703d34b4 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:03.370115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e88175cd-c962-4b46-80a0-8c11703d34b4 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:03.377848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e88175cd-c962-4b46-80a0-8c11703d34b4 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1209 microversion: 2.1 time: 0.093334 Jun 21 16:51:03.378415 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 154/299] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:03 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:03.759682 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:03.760412 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:03.768453 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:03.768726 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:03.770062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:03.770529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:03.855700 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-325573814", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "645d33ca-1458-475e-a591-c2b90b24a4f2"}], "security_groups": [{"name": "tempest-securitygroup--1366559969"}], "key_name": "tempest-keypair-1912144253", "user_data": "}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:03.905552 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:03.923040 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:03.925028 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:03.926167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-135a1312-d138-41a4-ac55-a6e93de6bcfe tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1744 microversion: 2.20 time: 0.171133 Jun 21 16:51:03.926720 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 146/300] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:03 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:03.963329 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] validate_networks() for [('645d33ca-1458-475e-a591-c2b90b24a4f2', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:51:03.969438 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-596cff8e-4e87-4d9c-b698-1b9df85799a4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:03.970080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-596cff8e-4e87-4d9c-b698-1b9df85799a4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:03.977154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-596cff8e-4e87-4d9c-b698-1b9df85799a4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:03.977692 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-596cff8e-4e87-4d9c-b698-1b9df85799a4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:03.978453 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-596cff8e-4e87-4d9c-b698-1b9df85799a4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:03.978877 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-596cff8e-4e87-4d9c-b698-1b9df85799a4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:04.113496 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-596cff8e-4e87-4d9c-b698-1b9df85799a4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:04.121514 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-596cff8e-4e87-4d9c-b698-1b9df85799a4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.155806 Jun 21 16:51:04.122075 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 147/301] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:03 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:04.336563 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:51:04.337024 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:51:04.337526 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:51:04.337935 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:51:04.338383 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:51:04.348384 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:04.348844 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:04.349657 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:04.350081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:04.367995 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Getting quotas for project 25beca9acf4f4420b1a2dc0ec397847e. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:51:04.373346 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Getting quotas for user f45384380b364e60823101515b359ba6 and project 25beca9acf4f4420b1a2dc0ec397847e. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:51:04.384423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:51:04.386707 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:51:04.394242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f8835d07-730b-45fd-b783-f3ce6f2366a8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:04.394852 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f8835d07-730b-45fd-b783-f3ce6f2366a8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:04.401097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8835d07-730b-45fd-b783-f3ce6f2366a8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:04.401571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8835d07-730b-45fd-b783-f3ce6f2366a8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:04.402340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8835d07-730b-45fd-b783-f3ce6f2366a8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:04.402774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8835d07-730b-45fd-b783-f3ce6f2366a8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:04.467393 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f8835d07-730b-45fd-b783-f3ce6f2366a8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:04.479531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f8835d07-730b-45fd-b783-f3ce6f2366a8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1209 microversion: 2.1 time: 0.085189 Jun 21 16:51:04.479531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 148/302] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:04 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:04.519096 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a26be1fc-b9b2-4726-8217-2eb22497c753 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.667793 Jun 21 16:51:04.519736 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 155/303] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:51:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 16:51:04.530351 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-21dff9df-edbf-42e4-9c84-addd8088acc0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:04.530954 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-21dff9df-edbf-42e4-9c84-addd8088acc0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:04.593158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-21dff9df-edbf-42e4-9c84-addd8088acc0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:04.601601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-21dff9df-edbf-42e4-9c84-addd8088acc0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1245 microversion: 2.1 time: 0.075808 Jun 21 16:51:04.602618 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 149/304] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:04 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:04.946648 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:04.947251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:04.954093 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:04.954607 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:04.955383 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:04.955821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:05.108111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:05.117226 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:05.118789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:05.119932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d525a780-1e9a-4711-b7bc-73915ed73ce6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.177744 Jun 21 16:51:05.120480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 156/305] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:04 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:05.139060 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-df9bbce3-07e3-45dd-bc48-cf188ad64294 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:05.139662 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-df9bbce3-07e3-45dd-bc48-cf188ad64294 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:05.147928 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-df9bbce3-07e3-45dd-bc48-cf188ad64294 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:05.148615 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-df9bbce3-07e3-45dd-bc48-cf188ad64294 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:05.149774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-df9bbce3-07e3-45dd-bc48-cf188ad64294 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:05.150213 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-df9bbce3-07e3-45dd-bc48-cf188ad64294 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:05.291466 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-df9bbce3-07e3-45dd-bc48-cf188ad64294 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:05.302772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-df9bbce3-07e3-45dd-bc48-cf188ad64294 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.167400 Jun 21 16:51:05.303405 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 150/306] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:05 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:05.492159 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8eb1d285-4aaa-42b0-9b5f-24ef5480a547 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:05.493606 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8eb1d285-4aaa-42b0-9b5f-24ef5480a547 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:05.502086 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8eb1d285-4aaa-42b0-9b5f-24ef5480a547 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:05.502438 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8eb1d285-4aaa-42b0-9b5f-24ef5480a547 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:05.503423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8eb1d285-4aaa-42b0-9b5f-24ef5480a547 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:05.512379 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8eb1d285-4aaa-42b0-9b5f-24ef5480a547 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:05.579551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8eb1d285-4aaa-42b0-9b5f-24ef5480a547 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:05.600505 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8eb1d285-4aaa-42b0-9b5f-24ef5480a547 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1273 microversion: 2.1 time: 0.111775 Jun 21 16:51:05.601731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 157/307] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:05 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:05.619231 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-17ab5306-7f3b-466e-a198-4cacbd4ea7b5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:05.620072 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-17ab5306-7f3b-466e-a198-4cacbd4ea7b5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:05.629819 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17ab5306-7f3b-466e-a198-4cacbd4ea7b5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:05.630532 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17ab5306-7f3b-466e-a198-4cacbd4ea7b5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:05.631676 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17ab5306-7f3b-466e-a198-4cacbd4ea7b5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:05.632495 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17ab5306-7f3b-466e-a198-4cacbd4ea7b5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:05.757689 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-17ab5306-7f3b-466e-a198-4cacbd4ea7b5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:05.766555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-17ab5306-7f3b-466e-a198-4cacbd4ea7b5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1249 microversion: 2.1 time: 0.151480 Jun 21 16:51:05.767228 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 151/308] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:05 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1249 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:05.887143 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-6463be89-3033-4e17-9d82-c045c8d8d376 req-0308e288-0810-4bf1-bdcf-414db0c58324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9af742-a7f3-4113-8ace-571502dad309", "name": "network-vif-plugged", "status": "completed", "tag": "7b305906-1977-410d-88f8-b281cb089050"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:05.891467 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:05.911092 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6463be89-3033-4e17-9d82-c045c8d8d376 req-0308e288-0810-4bf1-bdcf-414db0c58324 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:05.912016 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6463be89-3033-4e17-9d82-c045c8d8d376 req-0308e288-0810-4bf1-bdcf-414db0c58324 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:05.952766 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-6463be89-3033-4e17-9d82-c045c8d8d376 req-0308e288-0810-4bf1-bdcf-414db0c58324 service nova] Creating event network-vif-plugged:7b305906-1977-410d-88f8-b281cb089050 for instance 0d9af742-a7f3-4113-8ace-571502dad309 on hv-cinder-79987 Jun 21 16:51:05.968305 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-6463be89-3033-4e17-9d82-c045c8d8d376 req-0308e288-0810-4bf1-bdcf-414db0c58324 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084780 Jun 21 16:51:05.969090 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 158/309] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:51:06.143219 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:06.144092 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:06.184538 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:06.184538 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:06.184538 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:06.184538 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:06.321596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-426e56c2-ab06-475e-bc59-0e1c4896b584 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:06.322468 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-426e56c2-ab06-475e-bc59-0e1c4896b584 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:06.329857 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-426e56c2-ab06-475e-bc59-0e1c4896b584 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:06.331347 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-426e56c2-ab06-475e-bc59-0e1c4896b584 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:06.332394 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-426e56c2-ab06-475e-bc59-0e1c4896b584 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:06.333055 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-426e56c2-ab06-475e-bc59-0e1c4896b584 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:06.483681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:06.498075 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:06.505184 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:06.506724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-329c5ac0-553c-46c1-b783-9e6bd591e4f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.370205 Jun 21 16:51:06.514281 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 152/310] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:06 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:06.540317 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-426e56c2-ab06-475e-bc59-0e1c4896b584 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:06.553004 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-426e56c2-ab06-475e-bc59-0e1c4896b584 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.235578 Jun 21 16:51:06.553965 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 159/311] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:06 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:06.619631 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-32f94964-a1f1-4327-93fe-abeaad4dadae tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:06.620234 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-32f94964-a1f1-4327-93fe-abeaad4dadae tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:06.626566 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-32f94964-a1f1-4327-93fe-abeaad4dadae tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:06.627495 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-32f94964-a1f1-4327-93fe-abeaad4dadae tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:06.628519 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-32f94964-a1f1-4327-93fe-abeaad4dadae tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:06.628996 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-32f94964-a1f1-4327-93fe-abeaad4dadae tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:06.788215 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a5d6bbf9-35c1-461c-9966-f25a712a4d5d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:06.789339 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a5d6bbf9-35c1-461c-9966-f25a712a4d5d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:06.797164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a5d6bbf9-35c1-461c-9966-f25a712a4d5d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:06.798051 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a5d6bbf9-35c1-461c-9966-f25a712a4d5d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:06.798890 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a5d6bbf9-35c1-461c-9966-f25a712a4d5d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:06.801766 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a5d6bbf9-35c1-461c-9966-f25a712a4d5d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:06.891236 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a5d6bbf9-35c1-461c-9966-f25a712a4d5d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:06.905439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a5d6bbf9-35c1-461c-9966-f25a712a4d5d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1297 microversion: 2.1 time: 0.123538 Jun 21 16:51:06.906038 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 160/312] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:06 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:06.933616 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-32f94964-a1f1-4327-93fe-abeaad4dadae tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:06.941932 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-32f94964-a1f1-4327-93fe-abeaad4dadae tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.326059 Jun 21 16:51:06.942541 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 153/313] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:06 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:07.536933 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:07.538350 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:07.551998 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:07.552797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:07.553856 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:07.554509 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:07.573341 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e97f342e-06ce-4af7-869d-71b5a69de186 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:07.573942 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e97f342e-06ce-4af7-869d-71b5a69de186 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:07.576529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:07.591417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e97f342e-06ce-4af7-869d-71b5a69de186 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:07.593692 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e97f342e-06ce-4af7-869d-71b5a69de186 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:07.594914 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e97f342e-06ce-4af7-869d-71b5a69de186 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:07.595520 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e97f342e-06ce-4af7-869d-71b5a69de186 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:07.751567 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:07.760309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:07.762332 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:07.763770 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ca3d8dc3-da68-4404-8c1b-54f6772c7532 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.234983 Jun 21 16:51:07.775514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 161/314] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:07 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:07.933227 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-acee93e1-b785-4e98-beb5-719e22add0a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:07.934064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-acee93e1-b785-4e98-beb5-719e22add0a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:07.943037 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acee93e1-b785-4e98-beb5-719e22add0a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:07.943824 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acee93e1-b785-4e98-beb5-719e22add0a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:07.945052 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acee93e1-b785-4e98-beb5-719e22add0a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:07.945776 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acee93e1-b785-4e98-beb5-719e22add0a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:08.076143 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-acee93e1-b785-4e98-beb5-719e22add0a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:08.084861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-acee93e1-b785-4e98-beb5-719e22add0a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1315 microversion: 2.1 time: 0.160905 Jun 21 16:51:08.086513 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 162/315] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:07 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:08.091398 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-dd146255-16f0-4d5a-b8a9-d1b91b01dbcb tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:08.092333 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-dd146255-16f0-4d5a-b8a9-d1b91b01dbcb tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:08.102962 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd146255-16f0-4d5a-b8a9-d1b91b01dbcb tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:08.103673 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd146255-16f0-4d5a-b8a9-d1b91b01dbcb tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:08.104797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd146255-16f0-4d5a-b8a9-d1b91b01dbcb tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:08.105616 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd146255-16f0-4d5a-b8a9-d1b91b01dbcb tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:08.153463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e97f342e-06ce-4af7-869d-71b5a69de186 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:08.164156 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e97f342e-06ce-4af7-869d-71b5a69de186 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.596404 Jun 21 16:51:08.164899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 154/316] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:07 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:08.278336 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-dd146255-16f0-4d5a-b8a9-d1b91b01dbcb tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:08.287807 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-dd146255-16f0-4d5a-b8a9-d1b91b01dbcb tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.199921 Jun 21 16:51:08.288396 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 163/317] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:08 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:08.789403 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:08.789403 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:08.791972 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:08.801111 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:08.802333 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:08.802854 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:09.104976 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-579493fc-1568-4cb5-9cb8-738e3c827a59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:09.106744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-579493fc-1568-4cb5-9cb8-738e3c827a59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:09.132815 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-579493fc-1568-4cb5-9cb8-738e3c827a59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:09.136638 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-579493fc-1568-4cb5-9cb8-738e3c827a59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:09.139189 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-579493fc-1568-4cb5-9cb8-738e3c827a59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:09.140135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-579493fc-1568-4cb5-9cb8-738e3c827a59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:09.356542 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:09.375204 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:09.379492 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:09.381257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bb3e092b-17cf-4ab8-a649-0117a2716982 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.601749 Jun 21 16:51:09.382540 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 155/318] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:08 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:09.389986 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-76304ca0-7c6d-49bd-a833-ed408ebbc3dd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:09.391042 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-76304ca0-7c6d-49bd-a833-ed408ebbc3dd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:09.406549 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-76304ca0-7c6d-49bd-a833-ed408ebbc3dd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:09.408033 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-76304ca0-7c6d-49bd-a833-ed408ebbc3dd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:09.411195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-76304ca0-7c6d-49bd-a833-ed408ebbc3dd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:09.411862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-76304ca0-7c6d-49bd-a833-ed408ebbc3dd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:09.472957 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-579493fc-1568-4cb5-9cb8-738e3c827a59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:09.493470 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-579493fc-1568-4cb5-9cb8-738e3c827a59 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.390513 Jun 21 16:51:09.494186 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 164/319] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:09 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:09.500172 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c24e01f7-ab54-4d5c-a498-3f288d93bc09 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:09.500777 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c24e01f7-ab54-4d5c-a498-3f288d93bc09 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:09.508126 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c24e01f7-ab54-4d5c-a498-3f288d93bc09 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:09.508582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c24e01f7-ab54-4d5c-a498-3f288d93bc09 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:09.509414 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c24e01f7-ab54-4d5c-a498-3f288d93bc09 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:09.509872 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c24e01f7-ab54-4d5c-a498-3f288d93bc09 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:09.741667 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c24e01f7-ab54-4d5c-a498-3f288d93bc09 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:09.753643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c24e01f7-ab54-4d5c-a498-3f288d93bc09 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.257944 Jun 21 16:51:09.764485 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 165/320] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:09 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:09.764485 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-3247a2d3-265c-4229-8ebc-07920e6f86fb req-b92f148c-9400-4d63-beb3-618311691071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34842a77-dcf1-4213-bc30-4bea3008101b", "tag": "0b65fac1-342c-4e9f-8694-8fc5264175c8"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:09.765562 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:09.773175 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-3247a2d3-265c-4229-8ebc-07920e6f86fb req-b92f148c-9400-4d63-beb3-618311691071 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:09.773699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-3247a2d3-265c-4229-8ebc-07920e6f86fb req-b92f148c-9400-4d63-beb3-618311691071 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:09.797022 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-3247a2d3-265c-4229-8ebc-07920e6f86fb req-b92f148c-9400-4d63-beb3-618311691071 service nova] Creating event network-changed:0b65fac1-342c-4e9f-8694-8fc5264175c8 for instance 34842a77-dcf1-4213-bc30-4bea3008101b on hv-cinder-79987 Jun 21 16:51:09.803989 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-3247a2d3-265c-4229-8ebc-07920e6f86fb req-b92f148c-9400-4d63-beb3-618311691071 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046651 Jun 21 16:51:09.803989 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 166/321] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:51:09.846240 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-76304ca0-7c6d-49bd-a833-ed408ebbc3dd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:09.857163 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-76304ca0-7c6d-49bd-a833-ed408ebbc3dd tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.473002 Jun 21 16:51:09.857998 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 156/322] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:09 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:10.401637 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:10.407936 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:10.411370 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:10.411370 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:10.412126 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:10.412785 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:10.512928 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-263d98cc-ff0d-4dd8-9dc0-6ed48c3db8fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:10.516920 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-263d98cc-ff0d-4dd8-9dc0-6ed48c3db8fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:10.523421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-263d98cc-ff0d-4dd8-9dc0-6ed48c3db8fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:10.525766 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-263d98cc-ff0d-4dd8-9dc0-6ed48c3db8fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:10.527529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-263d98cc-ff0d-4dd8-9dc0-6ed48c3db8fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:10.527987 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-263d98cc-ff0d-4dd8-9dc0-6ed48c3db8fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:10.726153 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:10.735645 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:10.738265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:10.739585 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f216380d-7722-4272-90e5-41779873e315 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.342700 Jun 21 16:51:10.750629 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 167/323] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:10 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:10.780223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5803f5a5-1c16-4182-82c0-2e3623ebef6f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:10.780223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5803f5a5-1c16-4182-82c0-2e3623ebef6f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:10.788207 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5803f5a5-1c16-4182-82c0-2e3623ebef6f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:10.789010 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5803f5a5-1c16-4182-82c0-2e3623ebef6f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:10.790126 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5803f5a5-1c16-4182-82c0-2e3623ebef6f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:10.790756 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5803f5a5-1c16-4182-82c0-2e3623ebef6f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:10.894798 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-263d98cc-ff0d-4dd8-9dc0-6ed48c3db8fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:10.911307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-263d98cc-ff0d-4dd8-9dc0-6ed48c3db8fb tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.403428 Jun 21 16:51:10.915442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 157/324] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:10 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:10.921760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-919e620e-4b6e-4f00-a5b4-bdf2e84136cc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:10.927767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-919e620e-4b6e-4f00-a5b4-bdf2e84136cc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:10.952225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-919e620e-4b6e-4f00-a5b4-bdf2e84136cc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:10.952888 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-919e620e-4b6e-4f00-a5b4-bdf2e84136cc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:10.954100 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-919e620e-4b6e-4f00-a5b4-bdf2e84136cc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:10.954787 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-919e620e-4b6e-4f00-a5b4-bdf2e84136cc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:11.045228 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-5803f5a5-1c16-4182-82c0-2e3623ebef6f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:11.059070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5803f5a5-1c16-4182-82c0-2e3623ebef6f tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.291134 Jun 21 16:51:11.079846 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 168/325] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:10 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:11.180232 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-919e620e-4b6e-4f00-a5b4-bdf2e84136cc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:11.197610 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-919e620e-4b6e-4f00-a5b4-bdf2e84136cc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.283446 Jun 21 16:51:11.220889 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 158/326] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:10 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:11.764960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:11.766396 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:11.789343 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:11.795128 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:11.795128 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:11.795128 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:11.835855 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-59ea5898-8d44-4a7a-ad0a-476c9df90f0c req-e6c7b1e8-37b5-42e2-93c8-60654fe8e8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd85d90-a058-4a02-b0c5-acde031fa94f", "tag": "205be5db-3ab1-4914-b8b3-31b16386f2c6"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:11.848388 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-59ea5898-8d44-4a7a-ad0a-476c9df90f0c req-e6c7b1e8-37b5-42e2-93c8-60654fe8e8ae service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:11.849094 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-59ea5898-8d44-4a7a-ad0a-476c9df90f0c req-e6c7b1e8-37b5-42e2-93c8-60654fe8e8ae service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:11.897418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-59ea5898-8d44-4a7a-ad0a-476c9df90f0c req-e6c7b1e8-37b5-42e2-93c8-60654fe8e8ae service nova] Creating event network-changed:205be5db-3ab1-4914-b8b3-31b16386f2c6 for instance 7bd85d90-a058-4a02-b0c5-acde031fa94f on hv-cinder-79987 Jun 21 16:51:11.911887 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-59ea5898-8d44-4a7a-ad0a-476c9df90f0c req-e6c7b1e8-37b5-42e2-93c8-60654fe8e8ae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089298 Jun 21 16:51:11.915525 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 159/327] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:51:11.930113 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-021d21b0-7431-472f-8b81-8de5367072a5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:11.930805 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-021d21b0-7431-472f-8b81-8de5367072a5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:11.941907 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-021d21b0-7431-472f-8b81-8de5367072a5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:11.942624 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-021d21b0-7431-472f-8b81-8de5367072a5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:11.943568 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-021d21b0-7431-472f-8b81-8de5367072a5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:11.944156 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-021d21b0-7431-472f-8b81-8de5367072a5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:12.078374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:12.090829 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:12.092327 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:12.093525 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e2da2a02-122b-4f54-96dc-99a073978eaa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.337767 Jun 21 16:51:12.105862 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 169/328] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:11 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:12.107658 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8c401db2-dc68-4f9f-9d65-26fa9e2954e1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:12.108257 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8c401db2-dc68-4f9f-9d65-26fa9e2954e1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:12.118008 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c401db2-dc68-4f9f-9d65-26fa9e2954e1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:12.119247 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c401db2-dc68-4f9f-9d65-26fa9e2954e1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:12.120986 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c401db2-dc68-4f9f-9d65-26fa9e2954e1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:12.121800 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c401db2-dc68-4f9f-9d65-26fa9e2954e1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:12.338297 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8c401db2-dc68-4f9f-9d65-26fa9e2954e1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:12.346868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=100 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:12.353096 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8c401db2-dc68-4f9f-9d65-26fa9e2954e1 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.249067 Jun 21 16:51:12.364284 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 170/329] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:12 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:12.373108 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bbbfc514-f3b2-49ba-b4f4-f670622b372b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:12.375938 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-bbbfc514-f3b2-49ba-b4f4-f670622b372b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:12.385773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bbbfc514-f3b2-49ba-b4f4-f670622b372b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:12.387529 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bbbfc514-f3b2-49ba-b4f4-f670622b372b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:12.398341 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bbbfc514-f3b2-49ba-b4f4-f670622b372b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:12.399044 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bbbfc514-f3b2-49ba-b4f4-f670622b372b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:12.413493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-021d21b0-7431-472f-8b81-8de5367072a5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:12.435279 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-021d21b0-7431-472f-8b81-8de5367072a5 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.510805 Jun 21 16:51:12.444914 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 160/330] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:11 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:12.616892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-bbbfc514-f3b2-49ba-b4f4-f670622b372b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:12.627996 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-bbbfc514-f3b2-49ba-b4f4-f670622b372b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.261554 Jun 21 16:51:12.645400 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 171/331] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:12 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:13.120149 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:13.121867 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:13.132444 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:13.133200 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:13.134176 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:13.134761 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:13.372892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e8a7d95a-5c22-4657-9b01-faab8032c8fc tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:13.373532 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e8a7d95a-5c22-4657-9b01-faab8032c8fc tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:13.393037 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8a7d95a-5c22-4657-9b01-faab8032c8fc tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:13.393657 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8a7d95a-5c22-4657-9b01-faab8032c8fc tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:13.394670 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8a7d95a-5c22-4657-9b01-faab8032c8fc tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:13.395063 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8a7d95a-5c22-4657-9b01-faab8032c8fc tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:13.410872 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:13.423241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:13.425755 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:13.436818 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f6ec20ac-86da-4c95-beda-434907ec6152 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.313288 Jun 21 16:51:13.438165 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 161/332] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:13 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:13.462906 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e71b18b0-b81b-4c66-b0e3-e085bf2c56a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:13.463546 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e71b18b0-b81b-4c66-b0e3-e085bf2c56a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:13.471036 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e71b18b0-b81b-4c66-b0e3-e085bf2c56a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:13.471873 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e71b18b0-b81b-4c66-b0e3-e085bf2c56a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:13.472823 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e71b18b0-b81b-4c66-b0e3-e085bf2c56a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:13.473451 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e71b18b0-b81b-4c66-b0e3-e085bf2c56a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:13.569145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e8a7d95a-5c22-4657-9b01-faab8032c8fc tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:13.577431 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e8a7d95a-5c22-4657-9b01-faab8032c8fc tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.208771 Jun 21 16:51:13.582560 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 172/333] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:13 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:13.647989 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-aa27d9b4-7b75-4fed-8787-7bab68a01da1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:13.649923 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-aa27d9b4-7b75-4fed-8787-7bab68a01da1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:13.659816 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aa27d9b4-7b75-4fed-8787-7bab68a01da1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:13.661152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aa27d9b4-7b75-4fed-8787-7bab68a01da1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:13.662789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aa27d9b4-7b75-4fed-8787-7bab68a01da1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:13.663570 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aa27d9b4-7b75-4fed-8787-7bab68a01da1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:13.669362 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e71b18b0-b81b-4c66-b0e3-e085bf2c56a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:13.673386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=100 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:13.681395 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e71b18b0-b81b-4c66-b0e3-e085bf2c56a8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.222510 Jun 21 16:51:13.691473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 162/334] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:13 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:13.919352 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-aa27d9b4-7b75-4fed-8787-7bab68a01da1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:13.932445 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-aa27d9b4-7b75-4fed-8787-7bab68a01da1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1723 microversion: 2.1 time: 0.289160 Jun 21 16:51:13.934663 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 173/335] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:13 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:14.523383 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:14.523383 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:14.523383 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:14.523383 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:14.524540 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:14.524540 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:14.604077 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=12 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:14.612453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-338e7db7-df50-4527-9865-2a082166ad6d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:14.614126 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-338e7db7-df50-4527-9865-2a082166ad6d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:14.616240 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:14.618180 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=8 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:14.627314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-338e7db7-df50-4527-9865-2a082166ad6d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:14.628446 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-338e7db7-df50-4527-9865-2a082166ad6d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:14.629664 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-338e7db7-df50-4527-9865-2a082166ad6d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:14.630105 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-338e7db7-df50-4527-9865-2a082166ad6d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:14.661391 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:14.672304 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:14.675574 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:14.677802 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cda64121-2f4e-48c1-b488-d5703a80ec86 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.225180 Jun 21 16:51:14.679015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 163/336] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:14 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:14.698986 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-81ae0d91-5f40-408e-bc07-3ac68a109cff tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:14.699679 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-81ae0d91-5f40-408e-bc07-3ac68a109cff tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:14.707042 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-81ae0d91-5f40-408e-bc07-3ac68a109cff tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:14.707816 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-81ae0d91-5f40-408e-bc07-3ac68a109cff tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:14.708834 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-81ae0d91-5f40-408e-bc07-3ac68a109cff tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:14.709289 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-81ae0d91-5f40-408e-bc07-3ac68a109cff tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:14.793976 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-338e7db7-df50-4527-9865-2a082166ad6d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:14.808691 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-338e7db7-df50-4527-9865-2a082166ad6d tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.212759 Jun 21 16:51:14.809486 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 174/337] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:14 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:14.951778 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-930bc1b0-c1a2-42bb-9329-cc23b7f000a3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:14.952914 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-930bc1b0-c1a2-42bb-9329-cc23b7f000a3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:14.966164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-930bc1b0-c1a2-42bb-9329-cc23b7f000a3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:14.966593 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-930bc1b0-c1a2-42bb-9329-cc23b7f000a3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:14.967401 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-930bc1b0-c1a2-42bb-9329-cc23b7f000a3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:14.970896 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-930bc1b0-c1a2-42bb-9329-cc23b7f000a3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:15.012942 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-81ae0d91-5f40-408e-bc07-3ac68a109cff tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:15.040818 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-81ae0d91-5f40-408e-bc07-3ac68a109cff tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.339810 Jun 21 16:51:15.046299 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 164/338] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:14 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:15.223780 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-930bc1b0-c1a2-42bb-9329-cc23b7f000a3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:15.235164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-930bc1b0-c1a2-42bb-9329-cc23b7f000a3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1700 microversion: 2.1 time: 0.287346 Jun 21 16:51:15.236582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 175/339] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:14 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1700 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:15.254792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-15953d63-3c0f-40b9-ae69-8ee7e9ed8373 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:15.275039 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15953d63-3c0f-40b9-ae69-8ee7e9ed8373 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:15.275670 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15953d63-3c0f-40b9-ae69-8ee7e9ed8373 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:15.369169 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-15953d63-3c0f-40b9-ae69-8ee7e9ed8373 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Going to try to start instance {{(pid=124686) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 16:51:15.591970 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-15953d63-3c0f-40b9-ae69-8ee7e9ed8373 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/action" status: 202 len: 0 microversion: 2.1 time: 0.341343 Jun 21 16:51:15.594849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 165/340] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:51:15 2022] POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:51:15.607020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-33a5ee7e-a8d4-4ba4-bd19-0d4d84606107 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:15.607964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-33a5ee7e-a8d4-4ba4-bd19-0d4d84606107 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:15.617997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-33a5ee7e-a8d4-4ba4-bd19-0d4d84606107 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:15.620341 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-33a5ee7e-a8d4-4ba4-bd19-0d4d84606107 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:15.621685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-33a5ee7e-a8d4-4ba4-bd19-0d4d84606107 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:15.622371 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-33a5ee7e-a8d4-4ba4-bd19-0d4d84606107 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:15.697084 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:15.699126 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:15.717483 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:15.717483 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:15.717483 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:15.732505 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:15.907234 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-33a5ee7e-a8d4-4ba4-bd19-0d4d84606107 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:15.922405 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-33a5ee7e-a8d4-4ba4-bd19-0d4d84606107 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1709 microversion: 2.1 time: 0.320017 Jun 21 16:51:15.934450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 176/341] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:15 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1709 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:15.946913 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d66ac700-adad-40a1-8169-4df791553389 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:15.951761 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d66ac700-adad-40a1-8169-4df791553389 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:15.965866 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d66ac700-adad-40a1-8169-4df791553389 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:15.966781 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d66ac700-adad-40a1-8169-4df791553389 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:15.969527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d66ac700-adad-40a1-8169-4df791553389 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:15.979746 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d66ac700-adad-40a1-8169-4df791553389 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:16.202182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d66ac700-adad-40a1-8169-4df791553389 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:16.214251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d66ac700-adad-40a1-8169-4df791553389 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.277195 Jun 21 16:51:16.215407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 177/342] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:15 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:16.220744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3b78ca57-fcda-4b5e-8bb3-7ec1409c7f7f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:16.221368 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3b78ca57-fcda-4b5e-8bb3-7ec1409c7f7f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:16.228614 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b78ca57-fcda-4b5e-8bb3-7ec1409c7f7f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:16.230233 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b78ca57-fcda-4b5e-8bb3-7ec1409c7f7f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:16.231198 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b78ca57-fcda-4b5e-8bb3-7ec1409c7f7f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:16.231794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b78ca57-fcda-4b5e-8bb3-7ec1409c7f7f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:16.333647 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:16.356265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:16.359386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:16.367707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6271d2dd-b4e2-4be2-a35d-f8086a7ef8a2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.668348 Jun 21 16:51:16.370713 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 166/343] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:15 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:16.418310 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-f9ee1743-cb25-423d-8d02-8db902839b99 req-f75a5b8d-549a-43e7-bd02-c0cc9412d65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34842a77-dcf1-4213-bc30-4bea3008101b", "name": "network-vif-plugged", "status": "completed", "tag": "0b65fac1-342c-4e9f-8694-8fc5264175c8"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:16.439490 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-f9ee1743-cb25-423d-8d02-8db902839b99 req-f75a5b8d-549a-43e7-bd02-c0cc9412d65b service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:16.440161 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-f9ee1743-cb25-423d-8d02-8db902839b99 req-f75a5b8d-549a-43e7-bd02-c0cc9412d65b service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:16.501794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-f9ee1743-cb25-423d-8d02-8db902839b99 req-f75a5b8d-549a-43e7-bd02-c0cc9412d65b service nova] Creating event network-vif-plugged:0b65fac1-342c-4e9f-8694-8fc5264175c8 for instance 34842a77-dcf1-4213-bc30-4bea3008101b on hv-cinder-79987 Jun 21 16:51:16.522560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-f9ee1743-cb25-423d-8d02-8db902839b99 req-f75a5b8d-549a-43e7-bd02-c0cc9412d65b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104010 Jun 21 16:51:16.530367 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 167/344] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:51:16.544351 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3b78ca57-fcda-4b5e-8bb3-7ec1409c7f7f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:16.555741 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3b78ca57-fcda-4b5e-8bb3-7ec1409c7f7f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.338964 Jun 21 16:51:16.567748 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 178/345] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:16 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:16.946417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2e9882d4-5a65-43bf-a6cd-1325670243d2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:16.947350 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2e9882d4-5a65-43bf-a6cd-1325670243d2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:16.958880 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2e9882d4-5a65-43bf-a6cd-1325670243d2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:16.959349 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2e9882d4-5a65-43bf-a6cd-1325670243d2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:16.960147 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2e9882d4-5a65-43bf-a6cd-1325670243d2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:16.960594 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2e9882d4-5a65-43bf-a6cd-1325670243d2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:17.234499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6e233ddc-23d2-41d7-a3cb-78572005f837 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:17.236231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6e233ddc-23d2-41d7-a3cb-78572005f837 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:17.255746 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e233ddc-23d2-41d7-a3cb-78572005f837 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:17.256348 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e233ddc-23d2-41d7-a3cb-78572005f837 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:17.258043 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e233ddc-23d2-41d7-a3cb-78572005f837 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:17.259937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e233ddc-23d2-41d7-a3cb-78572005f837 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:17.277180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2e9882d4-5a65-43bf-a6cd-1325670243d2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:17.287865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2e9882d4-5a65-43bf-a6cd-1325670243d2 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1709 microversion: 2.1 time: 0.349084 Jun 21 16:51:17.294232 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 168/346] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:16 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1709 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:17.387537 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:17.388420 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:17.400914 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:17.402124 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:17.403906 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:17.404628 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:17.454107 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6e233ddc-23d2-41d7-a3cb-78572005f837 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:17.468479 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6e233ddc-23d2-41d7-a3cb-78572005f837 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.238652 Jun 21 16:51:17.469507 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 179/347] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:17 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:17.572206 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1e23d892-57f7-4874-80c1-35df7ca3611f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:17.572808 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1e23d892-57f7-4874-80c1-35df7ca3611f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:17.579363 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1e23d892-57f7-4874-80c1-35df7ca3611f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:17.580061 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1e23d892-57f7-4874-80c1-35df7ca3611f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:17.581585 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1e23d892-57f7-4874-80c1-35df7ca3611f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:17.582558 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1e23d892-57f7-4874-80c1-35df7ca3611f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:17.617935 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:17.631295 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:17.633069 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:17.638027 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f5c4c850-11da-43eb-925e-df0a69ec8fcc tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.253324 Jun 21 16:51:17.638880 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 169/348] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:17 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:17.799292 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1e23d892-57f7-4874-80c1-35df7ca3611f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:17.814394 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1e23d892-57f7-4874-80c1-35df7ca3611f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.241567 Jun 21 16:51:17.815028 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 180/349] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:17 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:18.313492 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1a4e0757-207a-4298-bfc9-22d1db59f3ef tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:18.322964 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1a4e0757-207a-4298-bfc9-22d1db59f3ef tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:18.338982 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a4e0757-207a-4298-bfc9-22d1db59f3ef tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:18.340437 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a4e0757-207a-4298-bfc9-22d1db59f3ef tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:18.342757 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a4e0757-207a-4298-bfc9-22d1db59f3ef tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:18.343211 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a4e0757-207a-4298-bfc9-22d1db59f3ef tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:18.489270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-534b7ec7-f357-413e-a997-5be5142e9be0 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:18.490583 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-534b7ec7-f357-413e-a997-5be5142e9be0 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:18.499801 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-534b7ec7-f357-413e-a997-5be5142e9be0 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:18.500621 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-534b7ec7-f357-413e-a997-5be5142e9be0 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:18.501735 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-534b7ec7-f357-413e-a997-5be5142e9be0 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:18.502482 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-534b7ec7-f357-413e-a997-5be5142e9be0 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:18.556984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1a4e0757-207a-4298-bfc9-22d1db59f3ef tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:18.569678 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1a4e0757-207a-4298-bfc9-22d1db59f3ef tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1709 microversion: 2.1 time: 0.267462 Jun 21 16:51:18.577190 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 170/350] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:18 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1709 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:18.585190 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-011a4ffe-ea09-4076-b787-52127e48fe92 req-779f2c1c-8223-4388-b2db-7355d395af1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd85d90-a058-4a02-b0c5-acde031fa94f", "name": "network-vif-plugged", "status": "completed", "tag": "205be5db-3ab1-4914-b8b3-31b16386f2c6"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:18.600924 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-011a4ffe-ea09-4076-b787-52127e48fe92 req-779f2c1c-8223-4388-b2db-7355d395af1d service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:18.738529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-011a4ffe-ea09-4076-b787-52127e48fe92 req-779f2c1c-8223-4388-b2db-7355d395af1d service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:18.738529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-011a4ffe-ea09-4076-b787-52127e48fe92 req-779f2c1c-8223-4388-b2db-7355d395af1d service nova] Creating event network-vif-plugged:205be5db-3ab1-4914-b8b3-31b16386f2c6 for instance 7bd85d90-a058-4a02-b0c5-acde031fa94f on hv-cinder-79987 Jun 21 16:51:18.738529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-011a4ffe-ea09-4076-b787-52127e48fe92 req-779f2c1c-8223-4388-b2db-7355d395af1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050315 Jun 21 16:51:18.738529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 171/351] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:51:18.738529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:18.739342 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:18.739342 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:18.739342 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:18.739342 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:18.740600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:18.740681 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-534b7ec7-f357-413e-a997-5be5142e9be0 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:18.740681 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-534b7ec7-f357-413e-a997-5be5142e9be0 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.230211 Jun 21 16:51:18.740681 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 181/352] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:18 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:18.844942 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:18.846970 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-32d4f843-59a9-4b0c-b255-0e0e78210cfd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:18.848053 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-32d4f843-59a9-4b0c-b255-0e0e78210cfd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:18.854676 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:18.858188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:18.859883 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3d298700-34a1-4ba5-9a45-ad074ef67694 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.205386 Jun 21 16:51:18.860269 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-32d4f843-59a9-4b0c-b255-0e0e78210cfd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:18.860865 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-32d4f843-59a9-4b0c-b255-0e0e78210cfd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:18.861416 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 172/353] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:18 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:51:18.870613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-32d4f843-59a9-4b0c-b255-0e0e78210cfd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:18.871156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-32d4f843-59a9-4b0c-b255-0e0e78210cfd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:19.029387 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-32d4f843-59a9-4b0c-b255-0e0e78210cfd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:19.037595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-32d4f843-59a9-4b0c-b255-0e0e78210cfd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.194705 Jun 21 16:51:19.038326 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 182/354] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:18 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:19.590274 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ed50d75a-c072-46d3-89cc-27e988331b4b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:19.591421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ed50d75a-c072-46d3-89cc-27e988331b4b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:19.600690 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ed50d75a-c072-46d3-89cc-27e988331b4b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:19.601129 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ed50d75a-c072-46d3-89cc-27e988331b4b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:19.601918 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ed50d75a-c072-46d3-89cc-27e988331b4b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:19.602347 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ed50d75a-c072-46d3-89cc-27e988331b4b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:19.743949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ed50d75a-c072-46d3-89cc-27e988331b4b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:19.752676 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ed50d75a-c072-46d3-89cc-27e988331b4b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1709 microversion: 2.1 time: 0.167411 Jun 21 16:51:19.753246 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 173/355] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:19 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:19.754641 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d47b7a18-37f4-48c1-82c6-b9581330b4bf tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:19.755374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d47b7a18-37f4-48c1-82c6-b9581330b4bf tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:19.762286 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d47b7a18-37f4-48c1-82c6-b9581330b4bf tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:19.762803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d47b7a18-37f4-48c1-82c6-b9581330b4bf tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:19.763630 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d47b7a18-37f4-48c1-82c6-b9581330b4bf tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:19.764116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d47b7a18-37f4-48c1-82c6-b9581330b4bf tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:19.880343 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:19.881077 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:19.892167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:19.896713 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:19.896713 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:19.896713 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:19.924757 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d47b7a18-37f4-48c1-82c6-b9581330b4bf tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:19.936792 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d47b7a18-37f4-48c1-82c6-b9581330b4bf tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1313 microversion: 2.1 time: 0.186623 Jun 21 16:51:19.937958 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 183/356] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:19 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:20.056289 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0d579552-86de-4f35-b01b-ab24fb376acf tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:20.057142 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0d579552-86de-4f35-b01b-ab24fb376acf tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:20.064849 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0d579552-86de-4f35-b01b-ab24fb376acf tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:20.066149 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0d579552-86de-4f35-b01b-ab24fb376acf tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:20.067881 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0d579552-86de-4f35-b01b-ab24fb376acf tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:20.068487 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0d579552-86de-4f35-b01b-ab24fb376acf tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:20.101721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:20.110103 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:20.112123 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:20.113576 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-22a79a7f-0aa5-4023-9a06-1c7733f35dab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.237431 Jun 21 16:51:20.114454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 174/357] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:19 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:51:20.286961 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0d579552-86de-4f35-b01b-ab24fb376acf tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:20.297792 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0d579552-86de-4f35-b01b-ab24fb376acf tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.247100 Jun 21 16:51:20.303911 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 184/358] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:20 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:20.770786 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e948f5b7-7a1a-4662-bfe9-c332f6b7dea3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:20.771398 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e948f5b7-7a1a-4662-bfe9-c332f6b7dea3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:20.779197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e948f5b7-7a1a-4662-bfe9-c332f6b7dea3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:20.779714 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e948f5b7-7a1a-4662-bfe9-c332f6b7dea3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:20.780490 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e948f5b7-7a1a-4662-bfe9-c332f6b7dea3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:20.780919 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e948f5b7-7a1a-4662-bfe9-c332f6b7dea3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:20.926790 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e948f5b7-7a1a-4662-bfe9-c332f6b7dea3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:20.934998 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e948f5b7-7a1a-4662-bfe9-c332f6b7dea3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1713 microversion: 2.1 time: 0.168284 Jun 21 16:51:20.935563 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 175/359] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:20 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1713 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:20.953848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3675d7c3-2c0f-4c5f-8b9c-982ea6e4e7b8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:20.954374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3675d7c3-2c0f-4c5f-8b9c-982ea6e4e7b8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:20.960855 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3675d7c3-2c0f-4c5f-8b9c-982ea6e4e7b8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:20.961321 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3675d7c3-2c0f-4c5f-8b9c-982ea6e4e7b8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:20.962089 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3675d7c3-2c0f-4c5f-8b9c-982ea6e4e7b8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:20.962521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3675d7c3-2c0f-4c5f-8b9c-982ea6e4e7b8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:21.136549 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:21.137417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:21.148125 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:21.148659 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:21.149567 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:21.150199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:21.327887 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3675d7c3-2c0f-4c5f-8b9c-982ea6e4e7b8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:21.336683 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3675d7c3-2c0f-4c5f-8b9c-982ea6e4e7b8 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1498 microversion: 2.1 time: 0.386676 Jun 21 16:51:21.337260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 185/360] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:20 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1498 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:21.339993 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:21.342497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e02aec37-1daf-4ccc-aaf8-aa7ff0d0b9f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:21.352697 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e02aec37-1daf-4ccc-aaf8-aa7ff0d0b9f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:21.353076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:21.353076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:21.353773 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-77783ae1-65cf-4986-b719-d54c2bfe9444 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1739 microversion: 2.20 time: 0.221329 Jun 21 16:51:21.360588 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 176/361] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:21 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:21.361192 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e02aec37-1daf-4ccc-aaf8-aa7ff0d0b9f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:21.365237 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e02aec37-1daf-4ccc-aaf8-aa7ff0d0b9f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:21.366241 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e02aec37-1daf-4ccc-aaf8-aa7ff0d0b9f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:21.366684 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e02aec37-1daf-4ccc-aaf8-aa7ff0d0b9f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:21.509913 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e02aec37-1daf-4ccc-aaf8-aa7ff0d0b9f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:21.517480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e02aec37-1daf-4ccc-aaf8-aa7ff0d0b9f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1371 microversion: 2.1 time: 0.178811 Jun 21 16:51:21.518444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 186/362] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:21 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:22.246187 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c2440eb5-4e7a-4e61-a72a-353919eb85ba tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:22.246798 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c2440eb5-4e7a-4e61-a72a-353919eb85ba tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:22.253420 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2440eb5-4e7a-4e61-a72a-353919eb85ba tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.253904 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2440eb5-4e7a-4e61-a72a-353919eb85ba tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.254718 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2440eb5-4e7a-4e61-a72a-353919eb85ba tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.255106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2440eb5-4e7a-4e61-a72a-353919eb85ba tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.283524 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c2440eb5-4e7a-4e61-a72a-353919eb85ba tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:51:22.380607 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:22.381327 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:22.388342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.389086 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.389638 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.390099 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.406861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=100 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:22.534862 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:22.543020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:22.544516 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:22.545694 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-dfcb19e1-2ff7-4245-8caa-c969ae2c4447 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1721 microversion: 2.20 time: 0.169667 Jun 21 16:51:22.546237 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 187/363] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:22 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:51:22.551299 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3b83b484-df78-4118-bfd2-52f68b6962d8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:22.551937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3b83b484-df78-4118-bfd2-52f68b6962d8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:22.558469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b83b484-df78-4118-bfd2-52f68b6962d8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.558917 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b83b484-df78-4118-bfd2-52f68b6962d8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.559988 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b83b484-df78-4118-bfd2-52f68b6962d8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.560448 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b83b484-df78-4118-bfd2-52f68b6962d8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.605019 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c2440eb5-4e7a-4e61-a72a-353919eb85ba tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "DELETE /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 204 len: 0 microversion: 2.1 time: 0.362510 Jun 21 16:51:22.605790 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 177/364] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:51:22 2022] DELETE /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:51:22.618429 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0b34b127-3dcd-4225-bae3-fb2cd488a451 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:22.619251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0b34b127-3dcd-4225-bae3-fb2cd488a451 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:22.626052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b34b127-3dcd-4225-bae3-fb2cd488a451 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.626883 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b34b127-3dcd-4225-bae3-fb2cd488a451 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.627513 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b34b127-3dcd-4225-bae3-fb2cd488a451 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.628171 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b34b127-3dcd-4225-bae3-fb2cd488a451 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.633368 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:22.720207 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3b83b484-df78-4118-bfd2-52f68b6962d8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:22.731094 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3b83b484-df78-4118-bfd2-52f68b6962d8 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1566 microversion: 2.1 time: 0.183603 Jun 21 16:51:22.745077 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 188/365] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:22 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:22.750761 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-89c99148-3d65-4545-818c-31baea29e09a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:22.751255 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-89c99148-3d65-4545-818c-31baea29e09a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:22.758910 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-89c99148-3d65-4545-818c-31baea29e09a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.759371 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-89c99148-3d65-4545-818c-31baea29e09a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.760235 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-89c99148-3d65-4545-818c-31baea29e09a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:22.760683 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-89c99148-3d65-4545-818c-31baea29e09a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:22.861495 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-89c99148-3d65-4545-818c-31baea29e09a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114444 Jun 21 16:51:22.862425 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 189/366] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 16:51:22 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:51:22.905356 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0b34b127-3dcd-4225-bae3-fb2cd488a451 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:22.914779 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0b34b127-3dcd-4225-bae3-fb2cd488a451 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1504 microversion: 2.1 time: 0.301840 Jun 21 16:51:22.915532 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 178/367] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:22 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:23.573769 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:23.575605 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:23.583660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:23.584110 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:23.585054 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:23.585675 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:23.857502 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:23.869299 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:23.870990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:23.871971 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d075a376-1633-40f9-8053-86e31d25f14c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1721 microversion: 2.20 time: 0.310627 Jun 21 16:51:23.872520 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 190/368] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:23 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1721 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:51:23.940131 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b60f561e-aa69-4b16-a26f-9ba0697e9e75 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:23.947706 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b60f561e-aa69-4b16-a26f-9ba0697e9e75 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:23.951915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b60f561e-aa69-4b16-a26f-9ba0697e9e75 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:23.952572 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b60f561e-aa69-4b16-a26f-9ba0697e9e75 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:23.957351 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b60f561e-aa69-4b16-a26f-9ba0697e9e75 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:23.957351 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b60f561e-aa69-4b16-a26f-9ba0697e9e75 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:24.108355 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-8422a1e1-36ad-4523-90d0-5daa4f70c7a1 req-19ba0205-ee7e-4425-940b-f920deed27f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd85d90-a058-4a02-b0c5-acde031fa94f", "tag": "205be5db-3ab1-4914-b8b3-31b16386f2c6"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:24.119354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-8422a1e1-36ad-4523-90d0-5daa4f70c7a1 req-19ba0205-ee7e-4425-940b-f920deed27f2 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:24.119810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-8422a1e1-36ad-4523-90d0-5daa4f70c7a1 req-19ba0205-ee7e-4425-940b-f920deed27f2 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:24.132161 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-8422a1e1-36ad-4523-90d0-5daa4f70c7a1 req-19ba0205-ee7e-4425-940b-f920deed27f2 service nova] Creating event network-changed:205be5db-3ab1-4914-b8b3-31b16386f2c6 for instance 7bd85d90-a058-4a02-b0c5-acde031fa94f on hv-cinder-79987 Jun 21 16:51:24.137738 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-8422a1e1-36ad-4523-90d0-5daa4f70c7a1 req-19ba0205-ee7e-4425-940b-f920deed27f2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033153 Jun 21 16:51:24.138562 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 191/369] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:51:24.530504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b60f561e-aa69-4b16-a26f-9ba0697e9e75 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:24.548161 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b60f561e-aa69-4b16-a26f-9ba0697e9e75 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1504 microversion: 2.1 time: 0.616076 Jun 21 16:51:24.548610 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 179/370] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:23 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1504 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:24.897243 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:24.898278 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:24.905915 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:24.906381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:24.907365 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:24.908107 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:25.093088 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:25.102428 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:25.104296 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:25.106997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c21958a2-8385-438a-8e51-fdc7cc135128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1721 microversion: 2.20 time: 0.219523 Jun 21 16:51:25.113716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 192/371] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:24 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:25.569740 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fd5ce2d1-92f0-4acd-a8a7-c5397411af1b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:25.570924 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-fd5ce2d1-92f0-4acd-a8a7-c5397411af1b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:25.577493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fd5ce2d1-92f0-4acd-a8a7-c5397411af1b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:25.578167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fd5ce2d1-92f0-4acd-a8a7-c5397411af1b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:25.579102 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fd5ce2d1-92f0-4acd-a8a7-c5397411af1b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:25.579908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fd5ce2d1-92f0-4acd-a8a7-c5397411af1b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:25.938970 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-233c3d7f-64bf-4667-992b-9ec1229ef681 req-aedb666d-4d10-448f-86fb-e6b6cc6741cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9af742-a7f3-4113-8ace-571502dad309", "name": "network-vif-unplugged", "status": "completed", "tag": "7b305906-1977-410d-88f8-b281cb089050"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:25.950155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-233c3d7f-64bf-4667-992b-9ec1229ef681 req-aedb666d-4d10-448f-86fb-e6b6cc6741cd service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:25.951067 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-233c3d7f-64bf-4667-992b-9ec1229ef681 req-aedb666d-4d10-448f-86fb-e6b6cc6741cd service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:25.966438 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-233c3d7f-64bf-4667-992b-9ec1229ef681 req-aedb666d-4d10-448f-86fb-e6b6cc6741cd service nova] Creating event network-vif-unplugged:7b305906-1977-410d-88f8-b281cb089050 for instance 0d9af742-a7f3-4113-8ace-571502dad309 on hv-cinder-79987 Jun 21 16:51:25.973076 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-233c3d7f-64bf-4667-992b-9ec1229ef681 req-aedb666d-4d10-448f-86fb-e6b6cc6741cd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037229 Jun 21 16:51:25.973866 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 193/372] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:51:26.127489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:26.129455 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:26.150480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:26.153248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:26.154277 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:26.155293 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:26.344241 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:26.353823 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:26.355770 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:26.357158 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-36e2ab19-ef0f-436b-8f91-beb9a97aad7c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1721 microversion: 2.20 time: 0.234101 Jun 21 16:51:26.357949 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 194/373] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:26 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:26.420215 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fd5ce2d1-92f0-4acd-a8a7-c5397411af1b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:26.431326 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fd5ce2d1-92f0-4acd-a8a7-c5397411af1b tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1504 microversion: 2.1 time: 0.865349 Jun 21 16:51:26.441876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 180/374] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:25 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1504 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:26.664296 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-5cd7031f-cc9d-4e40-af3c-e1351a799463 req-63ddcef8-2eb4-4657-9ac3-bf28c4557ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34842a77-dcf1-4213-bc30-4bea3008101b", "name": "network-vif-deleted", "tag": "0b65fac1-342c-4e9f-8694-8fc5264175c8"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:26.676852 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-5cd7031f-cc9d-4e40-af3c-e1351a799463 req-63ddcef8-2eb4-4657-9ac3-bf28c4557ece service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:26.677319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-5cd7031f-cc9d-4e40-af3c-e1351a799463 req-63ddcef8-2eb4-4657-9ac3-bf28c4557ece service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:26.699279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-5cd7031f-cc9d-4e40-af3c-e1351a799463 req-63ddcef8-2eb4-4657-9ac3-bf28c4557ece service nova] Creating event network-vif-deleted:0b65fac1-342c-4e9f-8694-8fc5264175c8 for instance 34842a77-dcf1-4213-bc30-4bea3008101b on hv-cinder-79987 Jun 21 16:51:26.706909 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-5cd7031f-cc9d-4e40-af3c-e1351a799463 req-63ddcef8-2eb4-4657-9ac3-bf28c4557ece service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046149 Jun 21 16:51:26.708167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 195/375] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:51:27.375582 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:27.376290 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:27.383746 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:27.384322 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:27.386162 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:27.387160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:27.450565 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-23b9365c-27ad-442b-b6e4-ca8e2a7aeb16 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:27.451258 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-23b9365c-27ad-442b-b6e4-ca8e2a7aeb16 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:27.465388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-23b9365c-27ad-442b-b6e4-ca8e2a7aeb16 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:27.466103 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-23b9365c-27ad-442b-b6e4-ca8e2a7aeb16 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:27.466888 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-23b9365c-27ad-442b-b6e4-ca8e2a7aeb16 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:27.467311 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-23b9365c-27ad-442b-b6e4-ca8e2a7aeb16 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:27.566054 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-23b9365c-27ad-442b-b6e4-ca8e2a7aeb16 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:27.575166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-23b9365c-27ad-442b-b6e4-ca8e2a7aeb16 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1462 microversion: 2.1 time: 0.129589 Jun 21 16:51:27.586026 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 196/376] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:27 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1462 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:51:27.595979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:27.604672 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:27.606453 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:27.607600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5762bb8a-a405-4452-ad60-0c5d68cadade tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1721 microversion: 2.20 time: 0.236215 Jun 21 16:51:27.608148 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 181/377] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:27 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:28.594215 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f960ab3c-d70e-4bc6-8f03-1c707878ce28 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:28.594832 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f960ab3c-d70e-4bc6-8f03-1c707878ce28 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:28.607057 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f960ab3c-d70e-4bc6-8f03-1c707878ce28 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:28.611873 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f960ab3c-d70e-4bc6-8f03-1c707878ce28 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:28.613079 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f960ab3c-d70e-4bc6-8f03-1c707878ce28 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:28.614472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f960ab3c-d70e-4bc6-8f03-1c707878ce28 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:28.633512 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:28.634125 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:28.681177 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:28.686987 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:28.687892 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:28.688335 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:28.747725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f960ab3c-d70e-4bc6-8f03-1c707878ce28 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c04cf84664a7582853dec90f130b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fb026ffcbd4a71929a4b3c860b3bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:28.793782 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f960ab3c-d70e-4bc6-8f03-1c707878ce28 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 200 len: 1298 microversion: 2.1 time: 0.203488 Jun 21 16:51:28.794742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 197/378] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:28 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 1298 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:51:28.996045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:29.008281 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:29.010022 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:29.011938 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9f84d14e-f7e9-4325-88ae-e427c8491bf0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1721 microversion: 2.20 time: 0.387795 Jun 21 16:51:29.013623 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 182/379] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:28 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1721 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:29.814869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:29.815480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] [instance: 34842a77-dcf1-4213-bc30-4bea3008101b] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:29.822329 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:29.822800 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:29.825240 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:29.825240 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:29.837871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] HTTP exception thrown: Instance 34842a77-dcf1-4213-bc30-4bea3008101b could not be found. Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Request method failure captured: Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b HTTP/1.1 Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfbRG-tTpUhiQQy4YfuMfFz3WJ4-nh29e8b3fJ_NjxyUFP5gTUIyThv719c4pIv_RExUIUAvEu4115CtMSSBx-oIGbixIPeKOM3AZZWWosYdh7ISI3v2E1FmJcYOE9Oz1c4H9hj4lI7CLoPJw22nimhh1kvPqvxDH_vyTDGA2KpMnvM Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 83fb026ffcbd4a71929a4b3c860b3bee Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-VolumesActionsTest-1528341730 Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:51:29.839554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83fb026ffcbd4a71929a4b3c860b3bee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/83fb026ffcbd4a71929a4b3c860b3bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83fb026ffcbd4a71929a4b3c860b3bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_83fb026ffcbd4a71929a4b3c860b3bee", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-VolumesActionsTest-1528341730 Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 83fb026ffcbd4a71929a4b3c860b3bee Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-VolumesActionsTest-1528341730 Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-VolumesActionsTest-1528341730-project Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 127c04cf84664a7582853dec90f130b6 Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-VolumesActionsTest-1528341730-project Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 34842a77-dcf1-4213-bc30-4bea3008101b could not be found. Jun 21 16:51:29.841112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '34842a77-dcf1-4213-bc30-4bea3008101b'} Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34842a77-dcf1-4213-bc30-4bea3008101b could not be found. Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:51:29.841977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34842a77-dcf1-4213-bc30-4bea3008101b could not be found. Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34842a77-dcf1-4213-bc30-4bea3008101b could not be found. Jun 21 16:51:29.843381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:51:29.844568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] Returning 404 to user: Instance 34842a77-dcf1-4213-bc30-4bea3008101b could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:51:29.844568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-bde31d6c-032f-4d63-95e1-766c1e2d3462 tempest-VolumesActionsTest-1528341730 tempest-VolumesActionsTest-1528341730-project] 10.222.0.70 "GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b" status: 404 len: 111 microversion: 2.1 time: 0.029986 Jun 21 16:51:29.846442 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 198/380] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:51:29 2022] GET /compute/v2.1/servers/34842a77-dcf1-4213-bc30-4bea3008101b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:51:30.032666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:30.033238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:30.041760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:30.042114 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:30.043251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:30.043431 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:30.275158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:30.290029 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:30.291914 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:30.293170 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-dfbfba77-1578-44d6-aff2-6b2142f7ab79 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1664 microversion: 2.20 time: 0.265506 Jun 21 16:51:30.293777 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 183/381] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:30 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1664 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:51:30.313905 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e641662d-fb43-402c-84f3-cfa9ef4a9fa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3355213d-c38a-4496-953d-f0d6d0e8b862"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:30.314977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e641662d-fb43-402c-84f3-cfa9ef4a9fa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:30.325175 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e641662d-fb43-402c-84f3-cfa9ef4a9fa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:30.326003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e641662d-fb43-402c-84f3-cfa9ef4a9fa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:30.327397 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e641662d-fb43-402c-84f3-cfa9ef4a9fa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:30.328525 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e641662d-fb43-402c-84f3-cfa9ef4a9fa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:31.774076 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e641662d-fb43-402c-84f3-cfa9ef4a9fa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.464075 Jun 21 16:51:31.776613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 199/382] 10.222.0.70 () {62 vars in 1363 bytes} [Tue Jun 21 16:51:30 2022] POST /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments => generated 188 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:51:31.971947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2b4cb4a6-9ab1-483e-a927-4f53a174ba08 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:31.972355 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2b4cb4a6-9ab1-483e-a927-4f53a174ba08 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:31.984979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2b4cb4a6-9ab1-483e-a927-4f53a174ba08 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:31.985845 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2b4cb4a6-9ab1-483e-a927-4f53a174ba08 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:31.987054 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2b4cb4a6-9ab1-483e-a927-4f53a174ba08 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:31.987832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2b4cb4a6-9ab1-483e-a927-4f53a174ba08 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:32.377128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2b4cb4a6-9ab1-483e-a927-4f53a174ba08 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/action" status: 202 len: 0 microversion: 2.20 time: 0.411123 Jun 21 16:51:32.378425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 184/383] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jun 21 16:51:31 2022] POST /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:51:32.392061 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:32.393057 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:32.405501 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:32.406369 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:32.408008 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:32.408954 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:32.664177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:32.687212 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:32.688720 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:32.693889 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1d8d1cdb-c8e7-4d43-9e76-a23fddee3cde tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1750 microversion: 2.20 time: 0.308559 Jun 21 16:51:32.694806 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 200/384] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:32 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1750 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:33.717475 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:33.721904 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:33.736942 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:33.740330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:33.742734 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:33.744930 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:34.091779 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:34.104349 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:34.105913 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:34.107306 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6de95ddc-88bd-4732-99e7-d810cd15cb6c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1750 microversion: 2.20 time: 0.396235 Jun 21 16:51:34.108498 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 185/385] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:33 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1750 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:35.127051 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:35.128564 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:35.136114 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:35.136566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:35.137380 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:35.137831 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:35.393020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:35.415690 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:35.418974 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:35.423316 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-cc7df67c-2e17-4cf7-a12f-47057937a81f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1750 microversion: 2.20 time: 0.298253 Jun 21 16:51:35.438595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 201/386] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:35 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1750 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:36.441023 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:36.442887 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:36.450722 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:36.451391 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:36.460420 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:36.460420 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:36.611290 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:36.622312 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:36.624625 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:36.627338 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d871e000-7db6-4790-96a1-bb037b2391a5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1752 microversion: 2.20 time: 0.190671 Jun 21 16:51:36.634781 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 186/387] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:36 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1752 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:37.270286 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ab89bcaa-26b1-4fd3-8666-94755387767c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Action: 'create', calling method: .version_select at 0x7f0a433f4d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-39343384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9OBaGyJmyGipMTcQC2fhzTs5gSxAc9ZdEZvJkU5DzvXRWli63uwmxwGeQxVY35e/qjHR58EJXE6B31ZFhmLOusH+jgZemZAL+JOyEwTXwS1qtIczfK52ZuNHgStJeR1w=="}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:51:37.278207 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=88 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:37.295759 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-ab89bcaa-26b1-4fd3-8666-94755387767c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Getting quotas for project 7ab25929bbd643a68f0f01f1fb22b292. Resources: {'key_pairs'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:51:37.299773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-ab89bcaa-26b1-4fd3-8666-94755387767c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Getting quotas for user 1da333ac86414ffd9661dbd15594e736 and project 7ab25929bbd643a68f0f01f1fb22b292. Resources: {'key_pairs'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:51:37.455152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ab89bcaa-26b1-4fd3-8666-94755387767c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.331670 Jun 21 16:51:37.461888 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 202/388] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 16:51:37 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:51:37.647730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:37.649931 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:37.678235 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:37.678793 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:37.679694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:37.680332 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:37.934464 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:37.949147 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:37.951281 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:37.952863 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-7008fcf5-3feb-444c-8481-7e414bf75829 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1752 microversion: 2.20 time: 0.310828 Jun 21 16:51:37.965313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 187/389] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:37 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1752 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:38.973977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:38.975071 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:38.983363 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:38.983819 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:38.992520 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:38.993451 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:39.275817 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:39.292112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:39.306943 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:39.306943 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-cef7f14b-06a1-44aa-a2c5-5ac88fa0324d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.331862 Jun 21 16:51:39.306943 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 203/390] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:38 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:40.323630 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:40.337613 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:40.352619 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:40.354495 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:40.355172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:40.356185 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:40.356624 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:40.585467 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:40.601009 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:40.609853 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:40.615028 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0b053e2d-4b64-4fcb-8996-255bed975252 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.295614 Jun 21 16:51:40.644116 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 188/391] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:40 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:41.639019 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:41.640357 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:41.651793 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:41.654336 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:41.656453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:41.657863 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:42.021990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:42.039835 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:42.039835 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:42.039835 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8e454a3c-1cee-4b15-8582-4395839fbb66 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.402925 Jun 21 16:51:42.040163 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 204/392] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:41 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:43.060015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:43.060808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:43.075280 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:43.075785 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:43.076709 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:43.077050 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:43.419818 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:43.429767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:43.431292 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:43.432498 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2ae483bd-cd92-4d00-9f41-de6e9b8e457a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.377967 Jun 21 16:51:43.433065 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 189/393] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:43 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:51:44.462900 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:44.463909 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:44.477503 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:44.477944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:44.478909 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:44.479379 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:44.502199 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:44.781391 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:44.801081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:44.803663 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:44.805056 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-90ee4965-ce88-43ee-abea-371930f0ab16 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.347209 Jun 21 16:51:44.810060 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 205/394] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:44 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:45.825158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:45.834642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:45.834642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:45.834642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:45.834642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:45.835093 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:45.974100 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:45.987024 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:45.988781 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:45.990625 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1e349e71-5687-47a5-8075-6eedd4f23495 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.169376 Jun 21 16:51:45.991187 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 190/395] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:45 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:47.010932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:47.012427 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:47.039340 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:47.043471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:47.044518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:47.046249 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:47.307599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=4 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:47.347330 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:47.358201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:47.359775 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:47.361060 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b01c0eb0-2256-446e-8875-5c194c50d439 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.354869 Jun 21 16:51:47.369328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 206/396] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:47 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:48.381592 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:48.382225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:48.389853 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:48.390624 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:48.391582 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:48.392248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:48.587129 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:48.597265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:48.600248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:48.601898 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-665e41c0-d6e7-4bb3-a8dc-59ac22cb5fda tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.225536 Jun 21 16:51:48.602645 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 191/397] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:48 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:49.623055 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:49.624376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:49.637960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:49.642229 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:49.642229 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:49.642229 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:49.994233 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:50.006135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:50.008011 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:50.009426 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d9c8ddee-fee2-4763-ba7c-d8b27c6e57d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.390091 Jun 21 16:51:50.010289 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 207/398] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:49 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:51.030665 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:51.032668 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:51.044989 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:51.045744 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:51.046741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:51.047367 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:51.285019 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:51.298634 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:51.300361 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:51.302022 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-aa6eb9cd-3c52-4e00-a646-c2f3b22f08cf tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.277013 Jun 21 16:51:51.303785 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 192/399] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:51 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:52.324536 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:52.326149 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:52.344067 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:52.345450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:52.349032 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:52.349758 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:52.548730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:52.560199 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:52.561731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:52.567448 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3acbaefc-2703-471d-897a-dab0b24614b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.244860 Jun 21 16:51:52.574536 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 208/400] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:52 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:51:53.593739 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:53.601866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:53.622749 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:53.623405 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:53.624869 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:53.626754 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:53.632572 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:51:53.804651 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:53.815106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:53.816877 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:53.818410 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b1c52cba-1f6f-4477-aeea-684de81b54be tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.229811 Jun 21 16:51:53.819623 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 193/401] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:53 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:54.846164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:54.848587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:54.881010 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:54.881967 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:54.883066 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:54.883782 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:55.078461 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:55.088123 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:55.090795 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:55.096145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-28425c1b-0564-4265-bd6b-54b4ea876323 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.258882 Jun 21 16:51:55.096145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 209/402] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:54 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:56.112694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:56.113298 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:56.121718 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:56.122193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:56.122978 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:56.123406 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:56.293479 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:56.302760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:56.305110 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:56.306514 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fef959ac-a61b-4bdd-8999-f07733258dec tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.198238 Jun 21 16:51:56.307546 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 194/403] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:56 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:57.327089 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:57.327683 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:57.334995 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:57.335503 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:57.336325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:57.336747 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:57.476158 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:57.485078 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:57.486613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:57.487766 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7b06f3e0-0853-454e-bfb1-d4e001f0faed tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.165467 Jun 21 16:51:57.488318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 210/404] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:57 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:58.510365 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:58.510365 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:58.517367 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:58.517807 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:58.518771 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:58.519204 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:58.679148 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:58.688072 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:58.689628 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:58.690787 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-03973cd6-b6d2-46cc-a3df-eecaf4c692eb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.186339 Jun 21 16:51:58.691354 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 195/405] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:58 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:51:59.709545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:51:59.710716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:51:59.717125 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:59.717684 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:59.718440 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:51:59.718874 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:51:59.858861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:59.868517 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:59.870106 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:51:59.871273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-36b49507-6393-4ae8-848d-32d8e7b007c0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.165837 Jun 21 16:51:59.871850 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 211/406] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:51:59 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:52:00.890059 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:00.890769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:00.897257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:00.897730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:00.898497 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:00.898956 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:01.036553 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:01.045688 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:01.047212 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:01.048375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-55fde9cf-4a81-4c1a-b25b-4ae9b50ff09c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.162284 Jun 21 16:52:01.048931 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 196/407] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:52:00 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:52:02.082186 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:02.082735 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:02.090406 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:02.090853 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:02.091677 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:02.092108 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:02.226012 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:02.234865 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:02.240223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:02.240223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fdab564f-1899-4db4-b25b-78e2c52c4b3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.160587 Jun 21 16:52:02.240223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 212/408] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:52:02 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:52:03.099161 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-13c10412-4c3f-42f3-a8a6-a30a59bdb32b req-c6cf63a5-a236-4f59-a2bd-f273a8de38eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9af742-a7f3-4113-8ace-571502dad309", "name": "network-vif-plugged", "status": "completed", "tag": "7b305906-1977-410d-88f8-b281cb089050"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:03.108742 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-13c10412-4c3f-42f3-a8a6-a30a59bdb32b req-c6cf63a5-a236-4f59-a2bd-f273a8de38eb service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:03.109195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-13c10412-4c3f-42f3-a8a6-a30a59bdb32b req-c6cf63a5-a236-4f59-a2bd-f273a8de38eb service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:03.121163 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-13c10412-4c3f-42f3-a8a6-a30a59bdb32b req-c6cf63a5-a236-4f59-a2bd-f273a8de38eb service nova] Creating event network-vif-plugged:7b305906-1977-410d-88f8-b281cb089050 for instance 0d9af742-a7f3-4113-8ace-571502dad309 on hv-cinder-79987 Jun 21 16:52:03.126270 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-13c10412-4c3f-42f3-a8a6-a30a59bdb32b req-c6cf63a5-a236-4f59-a2bd-f273a8de38eb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031261 Jun 21 16:52:03.126862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 197/409] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:03.258896 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:03.259439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:03.266246 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:03.268485 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:03.268485 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:03.268485 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:03.411339 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:03.421377 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:03.425191 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:03.425191 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-32d947af-0c2c-4827-8690-59efc7172c82 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.170259 Jun 21 16:52:03.425191 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 213/410] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:52:03 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:52:04.445142 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:04.446137 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:04.453844 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:04.454425 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:04.455189 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:04.455614 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:04.641984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:04.651378 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:04.652916 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:04.654226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ebdcd04d-e4bf-4da4-95e2-384945e4cf49 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.215429 Jun 21 16:52:04.654905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 198/411] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:52:04 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:52:05.677813 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:05.679653 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:05.691528 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:05.692440 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:05.694135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:05.695004 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:05.865675 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:05.876049 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:05.877556 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:05.878697 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4871c066-3843-4406-b3fd-1f4eb813aa13 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.208201 Jun 21 16:52:05.879252 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 214/412] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:52:05 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:52:06.900215 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:06.900959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:06.908055 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:06.908500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:06.909348 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:06.909782 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:07.124501 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:07.134672 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:07.138876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:07.140333 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d47a75b1-312a-4c57-878a-8848105c2bc6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1808 microversion: 2.20 time: 0.246025 Jun 21 16:52:07.141685 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 199/413] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:52:06 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:52:08.161106 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:08.162552 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:08.165712 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:08.171192 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:08.171875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:08.173093 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:08.173730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:08.360835 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:08.371498 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:08.373067 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:08.374671 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e3d3f1f2-beee-4d14-aca0-c1625ae463b6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1795 microversion: 2.20 time: 0.217562 Jun 21 16:52:08.375484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 215/414] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:52:08 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1795 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:52:14.710092 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-442913183", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-39343384", "security_groups": [{"name": "tempest-secgroup-smoke-1276392340"}], "networks": [{"uuid": "448d6feb-dc70-4b20-b57f-7b1ff3596a0e"}], "block_device_mapping_v2": [{"uuid": "57cc8c54-eccb-4fa1-863b-81c8106004cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:14.725805 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=24 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:15.131512 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.network.neutron [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] validate_networks() for [('448d6feb-dc70-4b20-b57f-7b1ff3596a0e', None, None, None, None, None)] {{(pid=124686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:52:15.798592 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Flavor limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:52:15.800466 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Image limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:52:15.801159 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Flavor pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:52:15.802358 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Image pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:52:15.802944 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:52:15.815336 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:15.816106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:15.816969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:15.817501 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:15.836378 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Getting quotas for project 7ab25929bbd643a68f0f01f1fb22b292. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:52:15.841313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Getting quotas for user 1da333ac86414ffd9661dbd15594e736 and project 7ab25929bbd643a68f0f01f1fb22b292. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:52:15.911518 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Going to run 1 instances... {{(pid=124686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:52:15.914397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57cc8c54-eccb-4fa1-863b-81c8106004cc',volume_size=None,volume_type=None)] {{(pid=124686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:52:16.391680 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-26b40c2a-b546-421f-9f0d-6e5e8935c709 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.685311 Jun 21 16:52:16.396022 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 200/415] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:52:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:52:16.406911 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-32b36027-b9cf-43ca-8169-070d12b08bc0 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:16.408121 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-32b36027-b9cf-43ca-8169-070d12b08bc0 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:16.490467 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-32b36027-b9cf-43ca-8169-070d12b08bc0 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:16.498341 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-32b36027-b9cf-43ca-8169-070d12b08bc0 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1086 microversion: 2.1 time: 0.095265 Jun 21 16:52:16.509972 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 216/416] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:16 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1086 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:17.463664 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a6093968-691f-4e5d-ac8f-3e96e0575fbf tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Action: 'create', calling method: .version_select at 0x7f0a42b95a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1039709549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0s3Wq6gu+Ne+CYrPWFGxm6MGhso70XzPt+eVOZhDsgQGRYMgT2RV0Hieksv1rg8Vz/c7xpPdM101TH/0Ny+vJeI8RDYXGfphzMM00mXsVslJcKdYu/g+0Bi9MJ/PUgng=="}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:17.479045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-a6093968-691f-4e5d-ac8f-3e96e0575fbf tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Getting quotas for project 7a8a0ae0c16a41c8b34547406830813a. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:52:17.482940 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-a6093968-691f-4e5d-ac8f-3e96e0575fbf tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Getting quotas for user 0ebe6382afe24ef489261081e8610271 and project 7a8a0ae0c16a41c8b34547406830813a. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:52:17.518936 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bc07b262-1af1-49e5-8ad5-e5d84a6a9e47 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:17.519768 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-bc07b262-1af1-49e5-8ad5-e5d84a6a9e47 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:17.578223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-bc07b262-1af1-49e5-8ad5-e5d84a6a9e47 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:17.587454 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-bc07b262-1af1-49e5-8ad5-e5d84a6a9e47 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1086 microversion: 2.1 time: 0.074564 Jun 21 16:52:17.588056 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 217/417] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:17 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1086 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:17.598868 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a6093968-691f-4e5d-ac8f-3e96e0575fbf tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.318809 Jun 21 16:52:17.599711 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 201/418] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 16:52:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:18.603979 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3e0103ef-bd35-4957-893a-b9c5de77b638 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:18.604596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3e0103ef-bd35-4957-893a-b9c5de77b638 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:18.607839 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=63 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:18.612254 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e0103ef-bd35-4957-893a-b9c5de77b638 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:18.612713 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e0103ef-bd35-4957-893a-b9c5de77b638 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:18.613522 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e0103ef-bd35-4957-893a-b9c5de77b638 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:18.613962 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e0103ef-bd35-4957-893a-b9c5de77b638 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:18.698673 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3e0103ef-bd35-4957-893a-b9c5de77b638 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:18.706469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3e0103ef-bd35-4957-893a-b9c5de77b638 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1184 microversion: 2.1 time: 0.106294 Jun 21 16:52:18.707228 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 218/419] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:18 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1184 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:19.724392 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3eb86786-03e4-44a8-b341-bbcf0509afc4 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:19.725254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3eb86786-03e4-44a8-b341-bbcf0509afc4 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:19.740200 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3eb86786-03e4-44a8-b341-bbcf0509afc4 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:19.740663 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3eb86786-03e4-44a8-b341-bbcf0509afc4 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:19.741804 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3eb86786-03e4-44a8-b341-bbcf0509afc4 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:19.742361 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3eb86786-03e4-44a8-b341-bbcf0509afc4 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:19.854429 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3eb86786-03e4-44a8-b341-bbcf0509afc4 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:19.869615 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3eb86786-03e4-44a8-b341-bbcf0509afc4 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1202 microversion: 2.1 time: 0.148585 Jun 21 16:52:19.891462 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 202/420] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:19 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:20.898897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-37a30323-0aba-42c1-9607-bc0d6f8be276 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:20.900151 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-37a30323-0aba-42c1-9607-bc0d6f8be276 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:20.907482 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-37a30323-0aba-42c1-9607-bc0d6f8be276 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:20.908224 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-37a30323-0aba-42c1-9607-bc0d6f8be276 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:20.909193 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-37a30323-0aba-42c1-9607-bc0d6f8be276 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:20.909807 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-37a30323-0aba-42c1-9607-bc0d6f8be276 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:21.110566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-37a30323-0aba-42c1-9607-bc0d6f8be276 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:21.120737 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-37a30323-0aba-42c1-9607-bc0d6f8be276 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1270 microversion: 2.1 time: 0.225797 Jun 21 16:52:21.121944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 219/421] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:20 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:21.310740 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4417d1e6-8874-4bc8-b245-66bd1c88e5a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5709ebd8-b2d8-4c04-b2f8-9aba27a6ebac"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:21.310740 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4417d1e6-8874-4bc8-b245-66bd1c88e5a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:21.312887 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4417d1e6-8874-4bc8-b245-66bd1c88e5a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:21.313362 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4417d1e6-8874-4bc8-b245-66bd1c88e5a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:21.314337 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4417d1e6-8874-4bc8-b245-66bd1c88e5a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:21.314776 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4417d1e6-8874-4bc8-b245-66bd1c88e5a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:21.738212 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-88ac894c-83fc-48de-a6dd-be283564650d req-cc3f8000-1cbc-42d6-842a-74cf989e089e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c7a8e0-22b7-46fd-8a39-03e153ce2dc4", "tag": "abae0918-ee64-4a4d-89a7-fad9196b8160"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:21.746961 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-88ac894c-83fc-48de-a6dd-be283564650d req-cc3f8000-1cbc-42d6-842a-74cf989e089e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:21.747409 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-88ac894c-83fc-48de-a6dd-be283564650d req-cc3f8000-1cbc-42d6-842a-74cf989e089e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:21.759448 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-88ac894c-83fc-48de-a6dd-be283564650d req-cc3f8000-1cbc-42d6-842a-74cf989e089e service nova] Creating event network-changed:abae0918-ee64-4a4d-89a7-fad9196b8160 for instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 on hv-cinder-79987 Jun 21 16:52:21.764834 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-88ac894c-83fc-48de-a6dd-be283564650d req-cc3f8000-1cbc-42d6-842a-74cf989e089e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031007 Jun 21 16:52:21.766255 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 220/422] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:22.139514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1e9311fa-9833-4427-91fd-accdcf578c16 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:22.140220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1e9311fa-9833-4427-91fd-accdcf578c16 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:22.146513 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1e9311fa-9833-4427-91fd-accdcf578c16 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:22.146957 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1e9311fa-9833-4427-91fd-accdcf578c16 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:22.147716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1e9311fa-9833-4427-91fd-accdcf578c16 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:22.148143 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1e9311fa-9833-4427-91fd-accdcf578c16 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:22.203485 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4417d1e6-8874-4bc8-b245-66bd1c88e5a6 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903098 Jun 21 16:52:22.204426 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 203/423] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:52:21 2022] POST /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments => generated 194 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:22.320320 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1e9311fa-9833-4427-91fd-accdcf578c16 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:22.331492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1e9311fa-9833-4427-91fd-accdcf578c16 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.197292 Jun 21 16:52:22.332099 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 221/424] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:22 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:22.924645 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-797142c5-285c-45c0-8b94-b41d58369c43 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:22.925367 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-797142c5-285c-45c0-8b94-b41d58369c43 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:22.932563 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-797142c5-285c-45c0-8b94-b41d58369c43 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:22.933002 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-797142c5-285c-45c0-8b94-b41d58369c43 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:22.933798 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-797142c5-285c-45c0-8b94-b41d58369c43 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:22.934222 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-797142c5-285c-45c0-8b94-b41d58369c43 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:23.065027 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-797142c5-285c-45c0-8b94-b41d58369c43 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lazy-loading 'services' on Instance uuid f605003b-48fd-4e3f-9f19-462e7b713558 {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:52:23.347834 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-818dd200-c921-40da-8730-f9642adba881 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:23.348439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-818dd200-c921-40da-8730-f9642adba881 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:23.355438 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-818dd200-c921-40da-8730-f9642adba881 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:23.355927 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-818dd200-c921-40da-8730-f9642adba881 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:23.356683 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-818dd200-c921-40da-8730-f9642adba881 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:23.357117 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-818dd200-c921-40da-8730-f9642adba881 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:23.386762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-797142c5-285c-45c0-8b94-b41d58369c43 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/os-volume_attachments/41bedc3d-d823-4bcf-9dfb-067cedfe1999" status: 202 len: 0 microversion: 2.1 time: 0.466021 Jun 21 16:52:23.387326 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 204/425] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 16:52:22 2022] DELETE /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/os-volume_attachments/41bedc3d-d823-4bcf-9dfb-067cedfe1999 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 16:52:23.503187 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-818dd200-c921-40da-8730-f9642adba881 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:23.511917 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-818dd200-c921-40da-8730-f9642adba881 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.167967 Jun 21 16:52:23.513968 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 222/426] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:23 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:24.529764 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-126b1d63-b78d-4c2a-9621-dd2998fc9061 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:24.530382 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-126b1d63-b78d-4c2a-9621-dd2998fc9061 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:24.537152 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-126b1d63-b78d-4c2a-9621-dd2998fc9061 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:24.537623 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-126b1d63-b78d-4c2a-9621-dd2998fc9061 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:24.538390 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-126b1d63-b78d-4c2a-9621-dd2998fc9061 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:24.538962 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-126b1d63-b78d-4c2a-9621-dd2998fc9061 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:24.680783 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-126b1d63-b78d-4c2a-9621-dd2998fc9061 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:24.688378 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-126b1d63-b78d-4c2a-9621-dd2998fc9061 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.164146 Jun 21 16:52:24.688946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 205/427] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:24 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:25.705210 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-411d622d-7238-4110-9e59-e96cb05565b8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:25.705868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-411d622d-7238-4110-9e59-e96cb05565b8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:25.712374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-411d622d-7238-4110-9e59-e96cb05565b8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:25.712821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-411d622d-7238-4110-9e59-e96cb05565b8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:25.713612 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-411d622d-7238-4110-9e59-e96cb05565b8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:25.714051 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-411d622d-7238-4110-9e59-e96cb05565b8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:25.850213 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-411d622d-7238-4110-9e59-e96cb05565b8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:25.858588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-411d622d-7238-4110-9e59-e96cb05565b8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.156865 Jun 21 16:52:25.859152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 223/428] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:25 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:26.875246 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cf225efc-fbc9-43b4-8660-2009e4f6f891 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:26.875895 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cf225efc-fbc9-43b4-8660-2009e4f6f891 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:26.878342 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:26.883206 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cf225efc-fbc9-43b4-8660-2009e4f6f891 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:26.883647 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cf225efc-fbc9-43b4-8660-2009e4f6f891 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:26.885054 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cf225efc-fbc9-43b4-8660-2009e4f6f891 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:26.885721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cf225efc-fbc9-43b4-8660-2009e4f6f891 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:26.888493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:27.023046 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cf225efc-fbc9-43b4-8660-2009e4f6f891 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:27.031548 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cf225efc-fbc9-43b4-8660-2009e4f6f891 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.160249 Jun 21 16:52:27.032115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 206/429] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:26 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:28.048619 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3db97b24-23ea-4755-a61e-dd871c571d9a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:28.049230 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3db97b24-23ea-4755-a61e-dd871c571d9a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:28.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=4 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:28.056505 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3db97b24-23ea-4755-a61e-dd871c571d9a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:28.056978 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3db97b24-23ea-4755-a61e-dd871c571d9a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:28.057774 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3db97b24-23ea-4755-a61e-dd871c571d9a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:28.058239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3db97b24-23ea-4755-a61e-dd871c571d9a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:28.194388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3db97b24-23ea-4755-a61e-dd871c571d9a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:28.202971 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3db97b24-23ea-4755-a61e-dd871c571d9a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.158394 Jun 21 16:52:28.203525 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 224/430] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:28 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:29.220962 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-82bb3c97-9ef5-48ec-a7b1-e8e7aa946a70 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:29.221670 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-82bb3c97-9ef5-48ec-a7b1-e8e7aa946a70 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:29.224075 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=10 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:29.230896 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-82bb3c97-9ef5-48ec-a7b1-e8e7aa946a70 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:29.231414 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-82bb3c97-9ef5-48ec-a7b1-e8e7aa946a70 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:29.232356 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-82bb3c97-9ef5-48ec-a7b1-e8e7aa946a70 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:29.232880 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-82bb3c97-9ef5-48ec-a7b1-e8e7aa946a70 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:29.367400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-82bb3c97-9ef5-48ec-a7b1-e8e7aa946a70 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:29.375660 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-82bb3c97-9ef5-48ec-a7b1-e8e7aa946a70 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.159666 Jun 21 16:52:29.376217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 207/431] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:29 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:30.394437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8fc81f29-fa26-4b1b-9379-865de4ff6769 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:30.395049 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8fc81f29-fa26-4b1b-9379-865de4ff6769 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:30.402097 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8fc81f29-fa26-4b1b-9379-865de4ff6769 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:30.402550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8fc81f29-fa26-4b1b-9379-865de4ff6769 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:30.403311 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8fc81f29-fa26-4b1b-9379-865de4ff6769 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:30.403743 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8fc81f29-fa26-4b1b-9379-865de4ff6769 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:30.540573 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8fc81f29-fa26-4b1b-9379-865de4ff6769 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:30.549139 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8fc81f29-fa26-4b1b-9379-865de4ff6769 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.159632 Jun 21 16:52:30.549719 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 225/432] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:30 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:30.792975 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e9635079-fea9-4105-a1fe-1d4dcb87cbf1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:30.794199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e9635079-fea9-4105-a1fe-1d4dcb87cbf1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:30.802368 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e9635079-fea9-4105-a1fe-1d4dcb87cbf1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:30.809812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e9635079-fea9-4105-a1fe-1d4dcb87cbf1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:30.809812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e9635079-fea9-4105-a1fe-1d4dcb87cbf1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:30.809812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e9635079-fea9-4105-a1fe-1d4dcb87cbf1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:30.830452 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-e9635079-fea9-4105-a1fe-1d4dcb87cbf1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lazy-loading 'flavor' on Instance uuid 7bd85d90-a058-4a02-b0c5-acde031fa94f {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:52:31.209004 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e9635079-fea9-4105-a1fe-1d4dcb87cbf1 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/action" status: 200 len: 32 microversion: 2.1 time: 0.420542 Jun 21 16:52:31.220130 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 208/433] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:52:30 2022] POST /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 16:52:31.220954 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-24b1773f-9da4-4be2-b455-9502dd870162 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:31.220954 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-24b1773f-9da4-4be2-b455-9502dd870162 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:31.227414 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24b1773f-9da4-4be2-b455-9502dd870162 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:31.228015 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24b1773f-9da4-4be2-b455-9502dd870162 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:31.228866 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24b1773f-9da4-4be2-b455-9502dd870162 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:31.229370 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-24b1773f-9da4-4be2-b455-9502dd870162 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:31.373195 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-24b1773f-9da4-4be2-b455-9502dd870162 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:31.382048 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-24b1773f-9da4-4be2-b455-9502dd870162 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.166930 Jun 21 16:52:31.382651 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 226/434] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:31 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:31.566420 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c0d79437-e73a-49a9-8e7e-8e75a05c23ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:31.567153 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c0d79437-e73a-49a9-8e7e-8e75a05c23ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:31.573493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c0d79437-e73a-49a9-8e7e-8e75a05c23ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:31.573943 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c0d79437-e73a-49a9-8e7e-8e75a05c23ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:31.574699 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c0d79437-e73a-49a9-8e7e-8e75a05c23ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:31.575133 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c0d79437-e73a-49a9-8e7e-8e75a05c23ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:31.808863 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c0d79437-e73a-49a9-8e7e-8e75a05c23ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:31.817380 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c0d79437-e73a-49a9-8e7e-8e75a05c23ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.255178 Jun 21 16:52:31.817981 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 209/435] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:31 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:31.914910 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fa4a01cb-586d-42ba-95af-3674cbe32b9c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:31.921604 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fa4a01cb-586d-42ba-95af-3674cbe32b9c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:31.922229 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fa4a01cb-586d-42ba-95af-3674cbe32b9c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:31.946142 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fa4a01cb-586d-42ba-95af-3674cbe32b9c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Going to try to stop instance {{(pid=124685) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 16:52:32.399232 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-611d3493-39b8-4f68-a91e-2899cd9894ce tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:32.399891 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-611d3493-39b8-4f68-a91e-2899cd9894ce tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:32.406369 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-611d3493-39b8-4f68-a91e-2899cd9894ce tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:32.406960 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-611d3493-39b8-4f68-a91e-2899cd9894ce tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:32.407752 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-611d3493-39b8-4f68-a91e-2899cd9894ce tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:32.408188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-611d3493-39b8-4f68-a91e-2899cd9894ce tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:32.426726 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fa4a01cb-586d-42ba-95af-3674cbe32b9c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/action" status: 202 len: 0 microversion: 2.1 time: 0.515490 Jun 21 16:52:32.428376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 227/436] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:52:31 2022] POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:52:32.455589 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-aff88c83-69c0-4c0c-873f-94dc810003ba tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:32.457674 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-aff88c83-69c0-4c0c-873f-94dc810003ba tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:32.464077 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aff88c83-69c0-4c0c-873f-94dc810003ba tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:32.464604 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aff88c83-69c0-4c0c-873f-94dc810003ba tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:32.466032 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aff88c83-69c0-4c0c-873f-94dc810003ba tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:32.466535 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aff88c83-69c0-4c0c-873f-94dc810003ba tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:32.571526 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-611d3493-39b8-4f68-a91e-2899cd9894ce tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:32.582529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-611d3493-39b8-4f68-a91e-2899cd9894ce tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.187264 Jun 21 16:52:32.589717 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 210/437] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:32 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:32.617960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-aff88c83-69c0-4c0c-873f-94dc810003ba tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:32.626398 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-aff88c83-69c0-4c0c-873f-94dc810003ba tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.192466 Jun 21 16:52:32.626990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 228/438] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:32 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:32.834413 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5d153a31-003f-4edd-83bb-791ed6e09fed tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:32.835152 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5d153a31-003f-4edd-83bb-791ed6e09fed tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:32.841658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5d153a31-003f-4edd-83bb-791ed6e09fed tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:32.842108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5d153a31-003f-4edd-83bb-791ed6e09fed tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:32.842878 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5d153a31-003f-4edd-83bb-791ed6e09fed tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:32.843315 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5d153a31-003f-4edd-83bb-791ed6e09fed tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:32.977490 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5d153a31-003f-4edd-83bb-791ed6e09fed tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:32.985946 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5d153a31-003f-4edd-83bb-791ed6e09fed tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.154549 Jun 21 16:52:32.986509 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 211/439] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:32 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:33.296026 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-a77d9f31-c801-4b83-825f-10a8174a34b5 req-377d351b-6d71-4784-8725-1744eef9279a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c7a8e0-22b7-46fd-8a39-03e153ce2dc4", "name": "network-vif-plugged", "status": "completed", "tag": "abae0918-ee64-4a4d-89a7-fad9196b8160"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:33.306156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-a77d9f31-c801-4b83-825f-10a8174a34b5 req-377d351b-6d71-4784-8725-1744eef9279a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:33.306591 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-a77d9f31-c801-4b83-825f-10a8174a34b5 req-377d351b-6d71-4784-8725-1744eef9279a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:33.318183 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-a77d9f31-c801-4b83-825f-10a8174a34b5 req-377d351b-6d71-4784-8725-1744eef9279a service nova] Creating event network-vif-plugged:abae0918-ee64-4a4d-89a7-fad9196b8160 for instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 on hv-cinder-79987 Jun 21 16:52:33.322895 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-a77d9f31-c801-4b83-825f-10a8174a34b5 req-377d351b-6d71-4784-8725-1744eef9279a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030725 Jun 21 16:52:33.329190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 229/440] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:33.600974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-27e7a128-6351-461d-943c-2e841f1cb7ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:33.601745 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-27e7a128-6351-461d-943c-2e841f1cb7ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:33.608222 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-27e7a128-6351-461d-943c-2e841f1cb7ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:33.608651 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-27e7a128-6351-461d-943c-2e841f1cb7ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:33.609485 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-27e7a128-6351-461d-943c-2e841f1cb7ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:33.610570 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-27e7a128-6351-461d-943c-2e841f1cb7ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:33.644949 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ca4f0c34-c595-452c-9862-f96d1f554efa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:33.645670 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ca4f0c34-c595-452c-9862-f96d1f554efa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:33.651821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca4f0c34-c595-452c-9862-f96d1f554efa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:33.652411 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca4f0c34-c595-452c-9862-f96d1f554efa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:33.653172 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca4f0c34-c595-452c-9862-f96d1f554efa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:33.653630 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ca4f0c34-c595-452c-9862-f96d1f554efa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:33.812118 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ca4f0c34-c595-452c-9862-f96d1f554efa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:33.818922 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ca4f0c34-c595-452c-9862-f96d1f554efa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.179074 Jun 21 16:52:33.819489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 230/441] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:33 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:33.900510 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-27e7a128-6351-461d-943c-2e841f1cb7ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:33.908969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-27e7a128-6351-461d-943c-2e841f1cb7ec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.311856 Jun 21 16:52:33.909697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 212/442] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:33 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:34.003676 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-14193d8f-bc90-4704-9fd0-cd8dbf1624e6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:34.004427 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-14193d8f-bc90-4704-9fd0-cd8dbf1624e6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:34.010667 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-14193d8f-bc90-4704-9fd0-cd8dbf1624e6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:34.011122 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-14193d8f-bc90-4704-9fd0-cd8dbf1624e6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:34.011886 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-14193d8f-bc90-4704-9fd0-cd8dbf1624e6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:34.012321 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-14193d8f-bc90-4704-9fd0-cd8dbf1624e6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:34.143955 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-14193d8f-bc90-4704-9fd0-cd8dbf1624e6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:34.152521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-14193d8f-bc90-4704-9fd0-cd8dbf1624e6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.153469 Jun 21 16:52:34.153429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 231/443] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:33 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:34.836025 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e20586ad-80b8-4430-a8fc-e33ecd375a16 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:34.836648 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e20586ad-80b8-4430-a8fc-e33ecd375a16 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:34.842923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e20586ad-80b8-4430-a8fc-e33ecd375a16 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:34.843361 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e20586ad-80b8-4430-a8fc-e33ecd375a16 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:34.844135 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e20586ad-80b8-4430-a8fc-e33ecd375a16 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:34.845148 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e20586ad-80b8-4430-a8fc-e33ecd375a16 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:34.927075 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ffeb29b6-cee3-4026-9064-4d4614534724 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:34.927686 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ffeb29b6-cee3-4026-9064-4d4614534724 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:34.934414 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ffeb29b6-cee3-4026-9064-4d4614534724 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:34.934872 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ffeb29b6-cee3-4026-9064-4d4614534724 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:34.935893 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ffeb29b6-cee3-4026-9064-4d4614534724 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:34.936325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ffeb29b6-cee3-4026-9064-4d4614534724 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:34.977412 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e20586ad-80b8-4430-a8fc-e33ecd375a16 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:34.985697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e20586ad-80b8-4430-a8fc-e33ecd375a16 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.152954 Jun 21 16:52:34.986281 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 213/444] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:34 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:35.066220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ffeb29b6-cee3-4026-9064-4d4614534724 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:35.074062 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ffeb29b6-cee3-4026-9064-4d4614534724 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.151446 Jun 21 16:52:35.076308 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 232/445] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:34 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:35.168993 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-66fec66b-e6c3-4784-988e-e05a8e3c204c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:35.169621 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-66fec66b-e6c3-4784-988e-e05a8e3c204c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:35.175942 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-66fec66b-e6c3-4784-988e-e05a8e3c204c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:35.176386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-66fec66b-e6c3-4784-988e-e05a8e3c204c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:35.177142 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-66fec66b-e6c3-4784-988e-e05a8e3c204c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:35.177613 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-66fec66b-e6c3-4784-988e-e05a8e3c204c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:35.318537 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-66fec66b-e6c3-4784-988e-e05a8e3c204c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:35.325940 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-66fec66b-e6c3-4784-988e-e05a8e3c204c tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1258 microversion: 2.1 time: 0.160798 Jun 21 16:52:35.326502 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 214/446] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:35 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:36.002306 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-caf52ad7-9535-4fd2-b510-a675ae36acc0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:36.002896 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-caf52ad7-9535-4fd2-b510-a675ae36acc0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:36.010270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-caf52ad7-9535-4fd2-b510-a675ae36acc0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:36.010725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-caf52ad7-9535-4fd2-b510-a675ae36acc0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:36.011499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-caf52ad7-9535-4fd2-b510-a675ae36acc0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:36.011934 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-caf52ad7-9535-4fd2-b510-a675ae36acc0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:36.093563 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4625c00e-760b-4acc-905d-14d3fb50ae0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:36.095196 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4625c00e-760b-4acc-905d-14d3fb50ae0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:36.108944 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4625c00e-760b-4acc-905d-14d3fb50ae0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:36.109417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4625c00e-760b-4acc-905d-14d3fb50ae0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:36.110865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4625c00e-760b-4acc-905d-14d3fb50ae0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:36.111541 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4625c00e-760b-4acc-905d-14d3fb50ae0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:36.157467 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-caf52ad7-9535-4fd2-b510-a675ae36acc0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:36.165111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-caf52ad7-9535-4fd2-b510-a675ae36acc0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.166649 Jun 21 16:52:36.165938 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 233/447] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:35 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:36.246389 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4625c00e-760b-4acc-905d-14d3fb50ae0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:36.255177 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4625c00e-760b-4acc-905d-14d3fb50ae0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.166630 Jun 21 16:52:36.255674 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 215/448] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:36 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:36.343257 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ab129152-d57f-44d2-9b18-09e025f83834 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:36.343853 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ab129152-d57f-44d2-9b18-09e025f83834 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:36.350263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ab129152-d57f-44d2-9b18-09e025f83834 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:36.350742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ab129152-d57f-44d2-9b18-09e025f83834 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:36.351503 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ab129152-d57f-44d2-9b18-09e025f83834 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:36.351942 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ab129152-d57f-44d2-9b18-09e025f83834 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:36.481620 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ab129152-d57f-44d2-9b18-09e025f83834 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:36.486000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:36.490609 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ab129152-d57f-44d2-9b18-09e025f83834 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1441 microversion: 2.1 time: 0.151167 Jun 21 16:52:36.491168 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 234/449] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:36 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1441 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:36.511921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ae9f830d-5f6a-4a90-838c-dc99a9b3b905 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:36.512876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ae9f830d-5f6a-4a90-838c-dc99a9b3b905 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:36.520327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae9f830d-5f6a-4a90-838c-dc99a9b3b905 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:36.520767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae9f830d-5f6a-4a90-838c-dc99a9b3b905 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:36.521554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae9f830d-5f6a-4a90-838c-dc99a9b3b905 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:36.521985 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae9f830d-5f6a-4a90-838c-dc99a9b3b905 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:36.654987 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ae9f830d-5f6a-4a90-838c-dc99a9b3b905 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:36.663023 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ae9f830d-5f6a-4a90-838c-dc99a9b3b905 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1441 microversion: 2.1 time: 0.155013 Jun 21 16:52:36.663619 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 216/450] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:36 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1441 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:37.182482 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-dc8ec1f2-8770-4b23-805e-b24358ec9732 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:37.183073 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-dc8ec1f2-8770-4b23-805e-b24358ec9732 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:37.190264 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dc8ec1f2-8770-4b23-805e-b24358ec9732 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:37.190789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dc8ec1f2-8770-4b23-805e-b24358ec9732 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:37.191562 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dc8ec1f2-8770-4b23-805e-b24358ec9732 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:37.191998 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dc8ec1f2-8770-4b23-805e-b24358ec9732 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:37.279841 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-74beffdb-adf5-4e57-afd5-3a1b4910bed9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:37.281202 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-74beffdb-adf5-4e57-afd5-3a1b4910bed9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:37.288456 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-74beffdb-adf5-4e57-afd5-3a1b4910bed9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:37.289142 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-74beffdb-adf5-4e57-afd5-3a1b4910bed9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:37.289963 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-74beffdb-adf5-4e57-afd5-3a1b4910bed9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:37.290560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-74beffdb-adf5-4e57-afd5-3a1b4910bed9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:37.334898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-dc8ec1f2-8770-4b23-805e-b24358ec9732 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:37.343143 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-dc8ec1f2-8770-4b23-805e-b24358ec9732 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.164340 Jun 21 16:52:37.343685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 235/451] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:37 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:37.528694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-74beffdb-adf5-4e57-afd5-3a1b4910bed9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:37.537895 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-74beffdb-adf5-4e57-afd5-3a1b4910bed9 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.264713 Jun 21 16:52:37.538478 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 217/452] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:37 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:38.360927 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-605d4a37-49ff-49a6-9115-d4b1df197254 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:38.361666 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-605d4a37-49ff-49a6-9115-d4b1df197254 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:38.364370 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=46 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:38.369474 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-605d4a37-49ff-49a6-9115-d4b1df197254 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:38.369923 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-605d4a37-49ff-49a6-9115-d4b1df197254 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:38.370686 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-605d4a37-49ff-49a6-9115-d4b1df197254 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:38.371202 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-605d4a37-49ff-49a6-9115-d4b1df197254 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:38.505260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-605d4a37-49ff-49a6-9115-d4b1df197254 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:38.513034 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-605d4a37-49ff-49a6-9115-d4b1df197254 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.155886 Jun 21 16:52:38.514423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 236/453] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:38 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:38.556177 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f2438a44-ac69-4860-8926-92a194e988c3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:38.556778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f2438a44-ac69-4860-8926-92a194e988c3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:38.563197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2438a44-ac69-4860-8926-92a194e988c3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:38.563648 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2438a44-ac69-4860-8926-92a194e988c3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:38.564408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2438a44-ac69-4860-8926-92a194e988c3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:38.565453 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2438a44-ac69-4860-8926-92a194e988c3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:38.753210 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f2438a44-ac69-4860-8926-92a194e988c3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:38.761605 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f2438a44-ac69-4860-8926-92a194e988c3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.209331 Jun 21 16:52:38.762174 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 218/454] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:38 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:38.950055 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-c6ce274e-7618-4916-a4cd-44b113556609 req-a9fcafbd-68ce-4b47-a082-39947f239e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c7a8e0-22b7-46fd-8a39-03e153ce2dc4", "tag": "abae0918-ee64-4a4d-89a7-fad9196b8160"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:38.958379 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-c6ce274e-7618-4916-a4cd-44b113556609 req-a9fcafbd-68ce-4b47-a082-39947f239e20 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:38.959271 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-c6ce274e-7618-4916-a4cd-44b113556609 req-a9fcafbd-68ce-4b47-a082-39947f239e20 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:38.970056 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-c6ce274e-7618-4916-a4cd-44b113556609 req-a9fcafbd-68ce-4b47-a082-39947f239e20 service nova] Creating event network-changed:abae0918-ee64-4a4d-89a7-fad9196b8160 for instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 on hv-cinder-79987 Jun 21 16:52:38.975126 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-c6ce274e-7618-4916-a4cd-44b113556609 req-a9fcafbd-68ce-4b47-a082-39947f239e20 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028742 Jun 21 16:52:38.975721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 237/455] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:39.530963 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-420cc49f-3d88-436f-a8cb-43a7ac9f5b3a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:39.531760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-420cc49f-3d88-436f-a8cb-43a7ac9f5b3a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:39.540178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-420cc49f-3d88-436f-a8cb-43a7ac9f5b3a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:39.540701 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-420cc49f-3d88-436f-a8cb-43a7ac9f5b3a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:39.541663 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-420cc49f-3d88-436f-a8cb-43a7ac9f5b3a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:39.542679 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-420cc49f-3d88-436f-a8cb-43a7ac9f5b3a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:39.686104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-420cc49f-3d88-436f-a8cb-43a7ac9f5b3a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:39.694380 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-420cc49f-3d88-436f-a8cb-43a7ac9f5b3a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.167140 Jun 21 16:52:39.694876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 219/456] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:39 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:39.780644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ae878bf0-934f-49ca-9cdc-593ea7c677cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:39.781476 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ae878bf0-934f-49ca-9cdc-593ea7c677cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:39.787843 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae878bf0-934f-49ca-9cdc-593ea7c677cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:39.788290 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae878bf0-934f-49ca-9cdc-593ea7c677cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:39.789051 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae878bf0-934f-49ca-9cdc-593ea7c677cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:39.789517 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae878bf0-934f-49ca-9cdc-593ea7c677cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:39.923247 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ae878bf0-934f-49ca-9cdc-593ea7c677cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:39.931677 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ae878bf0-934f-49ca-9cdc-593ea7c677cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.155738 Jun 21 16:52:39.932238 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 238/457] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:39 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:40.629730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1358194893", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1039709549", "security_groups": [{"name": "tempest-secgroup-smoke-254481239"}], "block_device_mapping_v2": [{"uuid": "31416ee1-486f-43fe-a753-6d1bbb824d34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c20083da-e0ff-47bb-b753-e54f100e0a6f"}]}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:40.712203 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ddaea78d-417d-40dd-97ad-e9266448f9ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:40.712907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ddaea78d-417d-40dd-97ad-e9266448f9ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:40.718910 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ddaea78d-417d-40dd-97ad-e9266448f9ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:40.719359 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ddaea78d-417d-40dd-97ad-e9266448f9ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:40.720124 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ddaea78d-417d-40dd-97ad-e9266448f9ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:40.720606 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ddaea78d-417d-40dd-97ad-e9266448f9ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:40.742132 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.network.neutron [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] validate_networks() for [('c20083da-e0ff-47bb-b753-e54f100e0a6f', None, None, None, None, None)] {{(pid=124686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:52:40.858022 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ddaea78d-417d-40dd-97ad-e9266448f9ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:40.865713 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ddaea78d-417d-40dd-97ad-e9266448f9ff tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.157287 Jun 21 16:52:40.866278 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 239/458] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:40 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:40.948502 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ab3728cc-af5c-44d9-b147-fdeb8e1c863e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:40.949106 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ab3728cc-af5c-44d9-b147-fdeb8e1c863e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:40.955042 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ab3728cc-af5c-44d9-b147-fdeb8e1c863e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:40.955531 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ab3728cc-af5c-44d9-b147-fdeb8e1c863e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:40.956848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ab3728cc-af5c-44d9-b147-fdeb8e1c863e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:40.957312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ab3728cc-af5c-44d9-b147-fdeb8e1c863e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:41.090772 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ab3728cc-af5c-44d9-b147-fdeb8e1c863e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:41.099342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ab3728cc-af5c-44d9-b147-fdeb8e1c863e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.154658 Jun 21 16:52:41.099920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 240/459] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:40 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:41.357707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Flavor limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:52:41.358160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Image limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:52:41.358634 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Flavor pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:52:41.359083 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Image pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:52:41.359491 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:52:41.369207 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:41.369687 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:41.370480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:41.370915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:41.388144 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Getting quotas for project 7a8a0ae0c16a41c8b34547406830813a. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:52:41.392106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Getting quotas for user 0ebe6382afe24ef489261081e8610271 and project 7a8a0ae0c16a41c8b34547406830813a. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:52:41.450561 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Going to run 1 instances... {{(pid=124686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:52:41.452763 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31416ee1-486f-43fe-a753-6d1bbb824d34',volume_size=None,volume_type=None)] {{(pid=124686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:52:41.882520 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6e14b6f1-61a1-48e0-a418-408cc3d5cf22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:41.883111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6e14b6f1-61a1-48e0-a418-408cc3d5cf22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:41.889605 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e14b6f1-61a1-48e0-a418-408cc3d5cf22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:41.890949 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e14b6f1-61a1-48e0-a418-408cc3d5cf22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:41.891743 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e14b6f1-61a1-48e0-a418-408cc3d5cf22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:41.892182 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d325c124-3064-4368-8ab0-cdedf72283ca tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.266980 Jun 21 16:52:41.892602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e14b6f1-61a1-48e0-a418-408cc3d5cf22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:41.894819 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 220/460] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:52:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:52:41.904551 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cbad13a1-66bd-4a13-9928-b40eb5b58c10 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:41.911820 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cbad13a1-66bd-4a13-9928-b40eb5b58c10 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:41.962024 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cbad13a1-66bd-4a13-9928-b40eb5b58c10 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:41.970293 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cbad13a1-66bd-4a13-9928-b40eb5b58c10 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1095 microversion: 2.1 time: 0.069628 Jun 21 16:52:41.971046 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 221/461] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:41 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:42.040455 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6e14b6f1-61a1-48e0-a418-408cc3d5cf22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:42.048089 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6e14b6f1-61a1-48e0-a418-408cc3d5cf22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.169385 Jun 21 16:52:42.048640 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 241/462] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:41 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:42.116694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1ff34cce-f024-4f9d-8fda-af956e8c7365 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:42.117347 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1ff34cce-f024-4f9d-8fda-af956e8c7365 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:42.123677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff34cce-f024-4f9d-8fda-af956e8c7365 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:42.124115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff34cce-f024-4f9d-8fda-af956e8c7365 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:42.124860 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff34cce-f024-4f9d-8fda-af956e8c7365 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:42.125299 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff34cce-f024-4f9d-8fda-af956e8c7365 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:42.140457 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:42.264839 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1ff34cce-f024-4f9d-8fda-af956e8c7365 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:42.273974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1ff34cce-f024-4f9d-8fda-af956e8c7365 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.161514 Jun 21 16:52:42.274542 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 222/463] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:42 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:42.988615 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-18fb2af0-2392-425d-89d4-4e8702f68fcc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:42.989163 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-18fb2af0-2392-425d-89d4-4e8702f68fcc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:42.996028 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-18fb2af0-2392-425d-89d4-4e8702f68fcc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:42.996471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-18fb2af0-2392-425d-89d4-4e8702f68fcc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:42.997234 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-18fb2af0-2392-425d-89d4-4e8702f68fcc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:42.997691 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-18fb2af0-2392-425d-89d4-4e8702f68fcc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:43.060319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-18fb2af0-2392-425d-89d4-4e8702f68fcc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:43.064631 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-363aec0a-2d11-45ff-9b39-64d1983b1379 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:43.065325 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-363aec0a-2d11-45ff-9b39-64d1983b1379 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:43.068813 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-18fb2af0-2392-425d-89d4-4e8702f68fcc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1145 microversion: 2.1 time: 0.084714 Jun 21 16:52:43.069443 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 242/464] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:42 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:43.079858 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-363aec0a-2d11-45ff-9b39-64d1983b1379 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:43.080297 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-363aec0a-2d11-45ff-9b39-64d1983b1379 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:43.081060 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-363aec0a-2d11-45ff-9b39-64d1983b1379 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:43.081964 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-363aec0a-2d11-45ff-9b39-64d1983b1379 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:43.225015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-363aec0a-2d11-45ff-9b39-64d1983b1379 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:43.232585 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-363aec0a-2d11-45ff-9b39-64d1983b1379 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.171735 Jun 21 16:52:43.233155 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 223/465] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:43 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:43.291215 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-dd6979eb-0bf8-4219-b7e4-1ecf967f012d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:43.292002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-dd6979eb-0bf8-4219-b7e4-1ecf967f012d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:43.298207 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd6979eb-0bf8-4219-b7e4-1ecf967f012d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:43.298699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd6979eb-0bf8-4219-b7e4-1ecf967f012d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:43.301379 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd6979eb-0bf8-4219-b7e4-1ecf967f012d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:43.301379 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd6979eb-0bf8-4219-b7e4-1ecf967f012d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:43.434705 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-dd6979eb-0bf8-4219-b7e4-1ecf967f012d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:43.442968 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-dd6979eb-0bf8-4219-b7e4-1ecf967f012d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.155634 Jun 21 16:52:43.443547 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 243/466] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:43 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:44.085759 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fcb93c7c-879e-44d8-b702-9d9a8222f3f2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:44.087560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-fcb93c7c-879e-44d8-b702-9d9a8222f3f2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:44.094074 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fcb93c7c-879e-44d8-b702-9d9a8222f3f2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:44.094609 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fcb93c7c-879e-44d8-b702-9d9a8222f3f2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:44.095363 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fcb93c7c-879e-44d8-b702-9d9a8222f3f2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:44.095817 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fcb93c7c-879e-44d8-b702-9d9a8222f3f2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:44.158785 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fcb93c7c-879e-44d8-b702-9d9a8222f3f2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:44.166264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fcb93c7c-879e-44d8-b702-9d9a8222f3f2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1193 microversion: 2.1 time: 0.084444 Jun 21 16:52:44.166815 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 224/467] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:44 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:44.251091 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5b1ca039-da4a-4a72-977a-5a8b9038766e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:44.251872 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5b1ca039-da4a-4a72-977a-5a8b9038766e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:44.259132 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5b1ca039-da4a-4a72-977a-5a8b9038766e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:44.259573 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5b1ca039-da4a-4a72-977a-5a8b9038766e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:44.260433 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5b1ca039-da4a-4a72-977a-5a8b9038766e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:44.260865 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5b1ca039-da4a-4a72-977a-5a8b9038766e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:44.402957 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-5b1ca039-da4a-4a72-977a-5a8b9038766e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:44.411146 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5b1ca039-da4a-4a72-977a-5a8b9038766e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.164020 Jun 21 16:52:44.411720 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 244/468] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:44 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:44.460836 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e2f0df7d-4208-4633-a991-e0a0bb3ce2cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:44.461467 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e2f0df7d-4208-4633-a991-e0a0bb3ce2cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:44.468595 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e2f0df7d-4208-4633-a991-e0a0bb3ce2cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:44.469081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e2f0df7d-4208-4633-a991-e0a0bb3ce2cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:44.469862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e2f0df7d-4208-4633-a991-e0a0bb3ce2cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:44.470346 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e2f0df7d-4208-4633-a991-e0a0bb3ce2cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:44.696298 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e2f0df7d-4208-4633-a991-e0a0bb3ce2cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:44.705756 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e2f0df7d-4208-4633-a991-e0a0bb3ce2cd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.249545 Jun 21 16:52:44.706637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 225/469] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:44 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:45.183999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-838fd2f6-f175-4e49-bbcc-85139ea51820 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:45.184519 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-838fd2f6-f175-4e49-bbcc-85139ea51820 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:45.191216 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-838fd2f6-f175-4e49-bbcc-85139ea51820 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:45.191814 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-838fd2f6-f175-4e49-bbcc-85139ea51820 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:45.192671 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-838fd2f6-f175-4e49-bbcc-85139ea51820 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:45.193107 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-838fd2f6-f175-4e49-bbcc-85139ea51820 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:45.349581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-838fd2f6-f175-4e49-bbcc-85139ea51820 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:45.358023 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-838fd2f6-f175-4e49-bbcc-85139ea51820 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1278 microversion: 2.1 time: 0.178046 Jun 21 16:52:45.358608 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 245/470] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:45 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:45.428508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-06fc5f37-457a-451f-b128-d68b19085caf tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:45.429186 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-06fc5f37-457a-451f-b128-d68b19085caf tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:45.431481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:45.436650 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-06fc5f37-457a-451f-b128-d68b19085caf tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:45.437062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-06fc5f37-457a-451f-b128-d68b19085caf tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:45.437856 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-06fc5f37-457a-451f-b128-d68b19085caf tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:45.438288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-06fc5f37-457a-451f-b128-d68b19085caf tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:45.692647 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-06fc5f37-457a-451f-b128-d68b19085caf tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:45.696303 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-06fc5f37-457a-451f-b128-d68b19085caf tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.272258 Jun 21 16:52:45.696876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 226/471] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:45 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:45.724922 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a92bd257-43f3-4478-8340-25fb4dd98448 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:45.727178 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a92bd257-43f3-4478-8340-25fb4dd98448 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:45.731685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a92bd257-43f3-4478-8340-25fb4dd98448 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:45.732434 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a92bd257-43f3-4478-8340-25fb4dd98448 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:45.732890 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a92bd257-43f3-4478-8340-25fb4dd98448 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:45.733707 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a92bd257-43f3-4478-8340-25fb4dd98448 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:45.874674 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a92bd257-43f3-4478-8340-25fb4dd98448 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:45.882928 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a92bd257-43f3-4478-8340-25fb4dd98448 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.163290 Jun 21 16:52:45.883494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 246/472] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:45 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:46.302257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-016c5c3e-f79e-4f31-bf9a-54b961401134 req-36720850-61e1-4f0e-ad52-f7370dbd92da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff16739-f953-4e6d-9c9c-c283d8ed7c33", "tag": "3b782323-0e20-4ed4-9fde-029d430c7e0e"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:46.313057 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-016c5c3e-f79e-4f31-bf9a-54b961401134 req-36720850-61e1-4f0e-ad52-f7370dbd92da service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:46.316735 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-016c5c3e-f79e-4f31-bf9a-54b961401134 req-36720850-61e1-4f0e-ad52-f7370dbd92da service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:46.330488 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-016c5c3e-f79e-4f31-bf9a-54b961401134 req-36720850-61e1-4f0e-ad52-f7370dbd92da service nova] Creating event network-changed:3b782323-0e20-4ed4-9fde-029d430c7e0e for instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 on hv-cinder-79987 Jun 21 16:52:46.336884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-016c5c3e-f79e-4f31-bf9a-54b961401134 req-36720850-61e1-4f0e-ad52-f7370dbd92da service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039642 Jun 21 16:52:46.337522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 227/473] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:46.376935 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8189a7c8-97d7-4420-b49c-55a069d5e960 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:46.377612 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8189a7c8-97d7-4420-b49c-55a069d5e960 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:46.389021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8189a7c8-97d7-4420-b49c-55a069d5e960 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:46.389656 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8189a7c8-97d7-4420-b49c-55a069d5e960 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:46.390529 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8189a7c8-97d7-4420-b49c-55a069d5e960 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:46.391180 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8189a7c8-97d7-4420-b49c-55a069d5e960 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:46.538044 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8189a7c8-97d7-4420-b49c-55a069d5e960 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:46.545930 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8189a7c8-97d7-4420-b49c-55a069d5e960 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.173275 Jun 21 16:52:46.546717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 247/474] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:46 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:46.714325 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b9517568-c0e6-4dec-814d-23cf67545e88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:46.715018 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b9517568-c0e6-4dec-814d-23cf67545e88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:46.721622 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b9517568-c0e6-4dec-814d-23cf67545e88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:46.722060 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b9517568-c0e6-4dec-814d-23cf67545e88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:46.724031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b9517568-c0e6-4dec-814d-23cf67545e88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:46.724457 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b9517568-c0e6-4dec-814d-23cf67545e88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:46.900065 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d1ff6059-ef12-41b7-82d3-0e8be36dead0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:46.900751 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d1ff6059-ef12-41b7-82d3-0e8be36dead0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:46.906691 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d1ff6059-ef12-41b7-82d3-0e8be36dead0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:46.907131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d1ff6059-ef12-41b7-82d3-0e8be36dead0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:46.907881 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d1ff6059-ef12-41b7-82d3-0e8be36dead0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:46.908306 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d1ff6059-ef12-41b7-82d3-0e8be36dead0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:46.930365 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b9517568-c0e6-4dec-814d-23cf67545e88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:46.937878 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b9517568-c0e6-4dec-814d-23cf67545e88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.227773 Jun 21 16:52:46.938450 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 228/475] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:46 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:47.041097 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d1ff6059-ef12-41b7-82d3-0e8be36dead0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:47.049132 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d1ff6059-ef12-41b7-82d3-0e8be36dead0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.152873 Jun 21 16:52:47.049731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 248/476] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:46 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:47.563861 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c02c3a35-d581-4829-ad46-00bc0de10956 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:47.564493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c02c3a35-d581-4829-ad46-00bc0de10956 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:47.571216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c02c3a35-d581-4829-ad46-00bc0de10956 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:47.571653 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c02c3a35-d581-4829-ad46-00bc0de10956 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:47.572403 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c02c3a35-d581-4829-ad46-00bc0de10956 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:47.572852 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c02c3a35-d581-4829-ad46-00bc0de10956 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:47.702790 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c02c3a35-d581-4829-ad46-00bc0de10956 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:47.711901 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c02c3a35-d581-4829-ad46-00bc0de10956 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.151874 Jun 21 16:52:47.712465 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 229/477] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:47 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:47.955449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e0379e1a-f855-4044-a9f5-fa17ad410807 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:47.955991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e0379e1a-f855-4044-a9f5-fa17ad410807 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:47.962613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e0379e1a-f855-4044-a9f5-fa17ad410807 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:47.963192 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e0379e1a-f855-4044-a9f5-fa17ad410807 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:47.963954 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e0379e1a-f855-4044-a9f5-fa17ad410807 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:47.964422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e0379e1a-f855-4044-a9f5-fa17ad410807 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:48.068257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bf8c2f14-4a68-4dd6-844b-b52c813afc5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:48.069725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bf8c2f14-4a68-4dd6-844b-b52c813afc5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:48.075221 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bf8c2f14-4a68-4dd6-844b-b52c813afc5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:48.075658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bf8c2f14-4a68-4dd6-844b-b52c813afc5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:48.076587 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bf8c2f14-4a68-4dd6-844b-b52c813afc5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:48.077019 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bf8c2f14-4a68-4dd6-844b-b52c813afc5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:48.103422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e0379e1a-f855-4044-a9f5-fa17ad410807 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:48.111349 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e0379e1a-f855-4044-a9f5-fa17ad410807 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1677 microversion: 2.1 time: 0.160018 Jun 21 16:52:48.112135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 249/478] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:47 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:48.215627 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bf8c2f14-4a68-4dd6-844b-b52c813afc5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:48.224042 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bf8c2f14-4a68-4dd6-844b-b52c813afc5f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.160943 Jun 21 16:52:48.224601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 230/479] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:48 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:48.728607 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-dfd561da-9a74-4a46-8c4f-0ff86a78df93 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:48.729207 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-dfd561da-9a74-4a46-8c4f-0ff86a78df93 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:48.735401 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dfd561da-9a74-4a46-8c4f-0ff86a78df93 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:48.735842 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dfd561da-9a74-4a46-8c4f-0ff86a78df93 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:48.736590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dfd561da-9a74-4a46-8c4f-0ff86a78df93 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:48.737022 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dfd561da-9a74-4a46-8c4f-0ff86a78df93 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:48.870619 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-dfd561da-9a74-4a46-8c4f-0ff86a78df93 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:48.878162 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-dfd561da-9a74-4a46-8c4f-0ff86a78df93 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.153441 Jun 21 16:52:48.878725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 250/480] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:48 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:49.129205 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5fd1adcb-688d-497a-bdad-e995aa9406fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:49.129850 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5fd1adcb-688d-497a-bdad-e995aa9406fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:49.136375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5fd1adcb-688d-497a-bdad-e995aa9406fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:49.136824 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5fd1adcb-688d-497a-bdad-e995aa9406fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:49.137617 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5fd1adcb-688d-497a-bdad-e995aa9406fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:49.138050 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5fd1adcb-688d-497a-bdad-e995aa9406fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:49.242245 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6e414c83-c4db-4b6f-b5fb-5800638203a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:49.242972 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6e414c83-c4db-4b6f-b5fb-5800638203a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:49.250003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e414c83-c4db-4b6f-b5fb-5800638203a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:49.250452 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e414c83-c4db-4b6f-b5fb-5800638203a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:49.251216 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e414c83-c4db-4b6f-b5fb-5800638203a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:49.251650 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e414c83-c4db-4b6f-b5fb-5800638203a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:49.274901 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5fd1adcb-688d-497a-bdad-e995aa9406fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:49.282501 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5fd1adcb-688d-497a-bdad-e995aa9406fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1654 microversion: 2.1 time: 0.157294 Jun 21 16:52:49.283380 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 231/481] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:49 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:49.300100 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ca4f6cc1-8430-431f-a6c4-b60eb78cb4e3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:49.307665 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ca4f6cc1-8430-431f-a6c4-b60eb78cb4e3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:49.308361 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ca4f6cc1-8430-431f-a6c4-b60eb78cb4e3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:49.331908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ca4f6cc1-8430-431f-a6c4-b60eb78cb4e3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Going to try to start instance {{(pid=124686) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 16:52:49.402819 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6e414c83-c4db-4b6f-b5fb-5800638203a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:49.410956 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6e414c83-c4db-4b6f-b5fb-5800638203a2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.173405 Jun 21 16:52:49.411559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 251/482] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:49 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:49.516065 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ca4f6cc1-8430-431f-a6c4-b60eb78cb4e3 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/action" status: 202 len: 0 microversion: 2.1 time: 0.219842 Jun 21 16:52:49.516676 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 232/483] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:52:49 2022] POST /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:52:49.525092 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-001ef952-1263-4d85-9d95-a1f17aa0b489 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:49.525717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-001ef952-1263-4d85-9d95-a1f17aa0b489 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:49.531838 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-001ef952-1263-4d85-9d95-a1f17aa0b489 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:49.532290 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-001ef952-1263-4d85-9d95-a1f17aa0b489 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:49.533121 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-001ef952-1263-4d85-9d95-a1f17aa0b489 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:49.533595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-001ef952-1263-4d85-9d95-a1f17aa0b489 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:49.543214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=100 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:49.663142 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-001ef952-1263-4d85-9d95-a1f17aa0b489 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:49.670576 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-001ef952-1263-4d85-9d95-a1f17aa0b489 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1663 microversion: 2.1 time: 0.149793 Jun 21 16:52:49.671155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 252/484] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:49 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:49.895794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-57e54584-da1b-4299-bfe3-89ba255f4034 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:49.896502 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-57e54584-da1b-4299-bfe3-89ba255f4034 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:49.902958 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-57e54584-da1b-4299-bfe3-89ba255f4034 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:49.903403 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-57e54584-da1b-4299-bfe3-89ba255f4034 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:49.904158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-57e54584-da1b-4299-bfe3-89ba255f4034 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:49.904584 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-57e54584-da1b-4299-bfe3-89ba255f4034 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:50.036657 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-57e54584-da1b-4299-bfe3-89ba255f4034 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:50.044060 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-57e54584-da1b-4299-bfe3-89ba255f4034 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.152716 Jun 21 16:52:50.044629 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 233/485] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:49 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:50.428871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8c0aa262-0695-408d-9401-87e17ec85575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:50.429506 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8c0aa262-0695-408d-9401-87e17ec85575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:50.435850 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c0aa262-0695-408d-9401-87e17ec85575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:50.436291 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c0aa262-0695-408d-9401-87e17ec85575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:50.437039 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c0aa262-0695-408d-9401-87e17ec85575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:50.437493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c0aa262-0695-408d-9401-87e17ec85575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:50.574033 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8c0aa262-0695-408d-9401-87e17ec85575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:50.582052 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8c0aa262-0695-408d-9401-87e17ec85575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1737 microversion: 2.1 time: 0.157990 Jun 21 16:52:50.582624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 253/486] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:50 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:50.688001 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-60f15d9d-8a95-43a2-868c-61f1a5da7364 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:50.688600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-60f15d9d-8a95-43a2-868c-61f1a5da7364 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:50.695072 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-60f15d9d-8a95-43a2-868c-61f1a5da7364 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:50.695506 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-60f15d9d-8a95-43a2-868c-61f1a5da7364 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:50.696284 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-60f15d9d-8a95-43a2-868c-61f1a5da7364 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:50.696730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-60f15d9d-8a95-43a2-868c-61f1a5da7364 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:50.827599 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-60f15d9d-8a95-43a2-868c-61f1a5da7364 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:50.835433 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-60f15d9d-8a95-43a2-868c-61f1a5da7364 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1663 microversion: 2.1 time: 0.151415 Jun 21 16:52:50.835991 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 234/487] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:50 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:51.061820 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c481e94a-1f1c-4e35-90f8-7c4ffb628c6f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:51.062376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c481e94a-1f1c-4e35-90f8-7c4ffb628c6f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:51.069529 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c481e94a-1f1c-4e35-90f8-7c4ffb628c6f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.069980 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c481e94a-1f1c-4e35-90f8-7c4ffb628c6f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.070839 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c481e94a-1f1c-4e35-90f8-7c4ffb628c6f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.071273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c481e94a-1f1c-4e35-90f8-7c4ffb628c6f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.207789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c481e94a-1f1c-4e35-90f8-7c4ffb628c6f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:51.217805 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c481e94a-1f1c-4e35-90f8-7c4ffb628c6f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.159964 Jun 21 16:52:51.220653 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 254/488] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:51 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:51.600457 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ece28aee-6f36-43cc-800e-91ee1ffdd575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:51.601085 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ece28aee-6f36-43cc-800e-91ee1ffdd575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:51.603071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:51.607917 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ece28aee-6f36-43cc-800e-91ee1ffdd575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.615939 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ece28aee-6f36-43cc-800e-91ee1ffdd575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.615939 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ece28aee-6f36-43cc-800e-91ee1ffdd575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.615939 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ece28aee-6f36-43cc-800e-91ee1ffdd575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.740818 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ece28aee-6f36-43cc-800e-91ee1ffdd575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:51.749005 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ece28aee-6f36-43cc-800e-91ee1ffdd575 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1717 microversion: 2.1 time: 0.153265 Jun 21 16:52:51.749595 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 235/489] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:51 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:51.852463 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-55fe57a3-78f7-428d-8332-31306dab2ec1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:51.853005 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-55fe57a3-78f7-428d-8332-31306dab2ec1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:51.854167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:51.854815 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:51.859892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-55fe57a3-78f7-428d-8332-31306dab2ec1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.860338 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-55fe57a3-78f7-428d-8332-31306dab2ec1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.860991 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.861110 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-55fe57a3-78f7-428d-8332-31306dab2ec1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.861484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.861614 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-55fe57a3-78f7-428d-8332-31306dab2ec1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.862251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.862687 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.947163 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] HTTP exception thrown: Cannot 'detach_volume' instance 7bd85d90-a058-4a02-b0c5-acde031fa94f while it is in vm_state rescued Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Request method failure captured: Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: DELETE /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments/5709ebd8-b2d8-4c04-b2f8-9aba27a6ebac HTTP/1.1 Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZn0mLuiXkothFA1iTZfSS5-_yLF0j6HitWawZCjgPGkA4OJxaSwSMT8mhFcZQGSPNw6xFR5WXxVCDVyimcJcr7TMO8KVpEXQe3RxCCLfR3ByFHqAWxQqI7UdhzT5l5J03QmKYOc-Sc6N3m_t-ei_BPoa2fHkg0tYS-JvarrnosSjI Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:52:51.948794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_25beca9acf4f4420b1a2dc0ec397847e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: f45384380b364e60823101515b359ba6 Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:52:51.950307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Cannot 'detach_volume' instance 7bd85d90-a058-4a02-b0c5-acde031fa94f while it is in vm_state rescued Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'server_id': '7bd85d90-a058-4a02-b0c5-acde031fa94f', 'id': '5709ebd8-b2d8-4c04-b2f8-9aba27a6ebac'} Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7bd85d90-a058-4a02-b0c5-acde031fa94f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:52:51.951007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7bd85d90-a058-4a02-b0c5-acde031fa94f while it is in vm_state rescued Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7bd85d90-a058-4a02-b0c5-acde031fa94f while it is in vm_state rescued Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:52:51.952442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Returning 409 to user: Cannot 'detach_volume' instance 7bd85d90-a058-4a02-b0c5-acde031fa94f while it is in vm_state rescued {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:52:51.953918 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-290d23db-88c6-456f-90bd-24b48384a67f tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments/5709ebd8-b2d8-4c04-b2f8-9aba27a6ebac" status: 409 len: 152 microversion: 2.1 time: 0.099968 Jun 21 16:52:51.953918 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 236/490] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 16:52:51 2022] DELETE /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments/5709ebd8-b2d8-4c04-b2f8-9aba27a6ebac => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 21 16:52:51.959359 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4b14ebbf-37b7-416d-929e-eb51ab96093b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:51.959883 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4b14ebbf-37b7-416d-929e-eb51ab96093b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:51.965947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b14ebbf-37b7-416d-929e-eb51ab96093b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.966387 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b14ebbf-37b7-416d-929e-eb51ab96093b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.967513 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b14ebbf-37b7-416d-929e-eb51ab96093b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:51.967952 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b14ebbf-37b7-416d-929e-eb51ab96093b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:51.968392 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=8 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:52.000326 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-55fe57a3-78f7-428d-8332-31306dab2ec1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:52.008292 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-55fe57a3-78f7-428d-8332-31306dab2ec1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1663 microversion: 2.1 time: 0.160329 Jun 21 16:52:52.009144 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 255/491] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:51 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:52.117979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:52:52.198282 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4b14ebbf-37b7-416d-929e-eb51ab96093b tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "POST /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/action" status: 202 len: 0 microversion: 2.1 time: 0.243073 Jun 21 16:52:52.199109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 237/492] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:52:51 2022] POST /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:52:52.207171 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b678b6c7-f958-43d2-af2b-ecf81498c810 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:52.211920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b678b6c7-f958-43d2-af2b-ecf81498c810 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:52.214887 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b678b6c7-f958-43d2-af2b-ecf81498c810 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:52.215339 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b678b6c7-f958-43d2-af2b-ecf81498c810 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:52.216132 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b678b6c7-f958-43d2-af2b-ecf81498c810 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:52.216567 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b678b6c7-f958-43d2-af2b-ecf81498c810 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:52.236286 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e7fcb7b6-36de-49a4-b575-0c23c3cce59d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:52.236980 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e7fcb7b6-36de-49a4-b575-0c23c3cce59d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:52.244466 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e7fcb7b6-36de-49a4-b575-0c23c3cce59d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:52.244909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e7fcb7b6-36de-49a4-b575-0c23c3cce59d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:52.245702 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e7fcb7b6-36de-49a4-b575-0c23c3cce59d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:52.246133 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e7fcb7b6-36de-49a4-b575-0c23c3cce59d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:52.361378 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b678b6c7-f958-43d2-af2b-ecf81498c810 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:52.374526 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b678b6c7-f958-43d2-af2b-ecf81498c810 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1725 microversion: 2.1 time: 0.168163 Jun 21 16:52:52.374526 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 256/493] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:52 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:52.406786 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e7fcb7b6-36de-49a4-b575-0c23c3cce59d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:52.415154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e7fcb7b6-36de-49a4-b575-0c23c3cce59d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.182999 Jun 21 16:52:52.415705 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 238/494] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:52 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:53.026584 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-519a3b41-e6ac-4bc5-ba44-4c0fb279fe2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:53.027230 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-519a3b41-e6ac-4bc5-ba44-4c0fb279fe2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:53.033688 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-519a3b41-e6ac-4bc5-ba44-4c0fb279fe2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:53.034130 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-519a3b41-e6ac-4bc5-ba44-4c0fb279fe2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:53.034873 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-519a3b41-e6ac-4bc5-ba44-4c0fb279fe2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:53.035298 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-519a3b41-e6ac-4bc5-ba44-4c0fb279fe2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:53.166962 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-519a3b41-e6ac-4bc5-ba44-4c0fb279fe2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:53.174589 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-519a3b41-e6ac-4bc5-ba44-4c0fb279fe2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1667 microversion: 2.1 time: 0.151814 Jun 21 16:52:53.175150 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 257/495] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:53 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:53.389969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8ad1cdab-1c92-45b0-81a4-f11b8c6051a7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:53.390568 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8ad1cdab-1c92-45b0-81a4-f11b8c6051a7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:53.397861 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8ad1cdab-1c92-45b0-81a4-f11b8c6051a7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:53.398421 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8ad1cdab-1c92-45b0-81a4-f11b8c6051a7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:53.399176 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8ad1cdab-1c92-45b0-81a4-f11b8c6051a7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:53.399630 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8ad1cdab-1c92-45b0-81a4-f11b8c6051a7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:53.431976 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-40b4ce20-fd48-4af6-b339-37b0a1fa992d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:53.432579 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-40b4ce20-fd48-4af6-b339-37b0a1fa992d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:53.438723 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-40b4ce20-fd48-4af6-b339-37b0a1fa992d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:53.439169 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-40b4ce20-fd48-4af6-b339-37b0a1fa992d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:53.439932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-40b4ce20-fd48-4af6-b339-37b0a1fa992d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:53.440367 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-40b4ce20-fd48-4af6-b339-37b0a1fa992d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:53.577375 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-40b4ce20-fd48-4af6-b339-37b0a1fa992d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:53.585636 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-40b4ce20-fd48-4af6-b339-37b0a1fa992d tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.157329 Jun 21 16:52:53.586488 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 258/496] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:53 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:53.607273 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8ad1cdab-1c92-45b0-81a4-f11b8c6051a7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:53.616382 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8ad1cdab-1c92-45b0-81a4-f11b8c6051a7 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1725 microversion: 2.1 time: 0.230312 Jun 21 16:52:53.616941 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 239/497] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:53 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:54.604036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-98f25187-3a1b-4ade-b6f8-f48e7eb6ea77 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:54.604704 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-98f25187-3a1b-4ade-b6f8-f48e7eb6ea77 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:54.611130 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-98f25187-3a1b-4ade-b6f8-f48e7eb6ea77 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:54.611576 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-98f25187-3a1b-4ade-b6f8-f48e7eb6ea77 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:54.612332 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-98f25187-3a1b-4ade-b6f8-f48e7eb6ea77 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:54.612765 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-98f25187-3a1b-4ade-b6f8-f48e7eb6ea77 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:54.635970 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-389d183b-f56b-4256-97f0-c24d3ef90854 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:54.636585 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-389d183b-f56b-4256-97f0-c24d3ef90854 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:54.643466 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-389d183b-f56b-4256-97f0-c24d3ef90854 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:54.643919 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-389d183b-f56b-4256-97f0-c24d3ef90854 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:54.644676 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-389d183b-f56b-4256-97f0-c24d3ef90854 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:54.645160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-389d183b-f56b-4256-97f0-c24d3ef90854 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:54.767054 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-98f25187-3a1b-4ade-b6f8-f48e7eb6ea77 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:54.774717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-98f25187-3a1b-4ade-b6f8-f48e7eb6ea77 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.175741 Jun 21 16:52:54.775217 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 259/498] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:54 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:54.794649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-389d183b-f56b-4256-97f0-c24d3ef90854 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:54.804050 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-389d183b-f56b-4256-97f0-c24d3ef90854 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1725 microversion: 2.1 time: 0.173579 Jun 21 16:52:54.804628 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 240/499] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:54 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:55.794076 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-14732c90-7af3-4142-ad65-29c7ac808ee1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:55.794794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-14732c90-7af3-4142-ad65-29c7ac808ee1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:55.803983 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-14732c90-7af3-4142-ad65-29c7ac808ee1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:55.803983 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-14732c90-7af3-4142-ad65-29c7ac808ee1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:55.804718 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-14732c90-7af3-4142-ad65-29c7ac808ee1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:55.805327 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-14732c90-7af3-4142-ad65-29c7ac808ee1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:55.821655 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f9669463-f8c8-40dd-a44c-86189deeaf69 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:55.822252 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f9669463-f8c8-40dd-a44c-86189deeaf69 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:55.828879 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9669463-f8c8-40dd-a44c-86189deeaf69 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:55.829431 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9669463-f8c8-40dd-a44c-86189deeaf69 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:55.830248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9669463-f8c8-40dd-a44c-86189deeaf69 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:55.830882 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9669463-f8c8-40dd-a44c-86189deeaf69 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:55.949864 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-14732c90-7af3-4142-ad65-29c7ac808ee1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:55.959310 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-14732c90-7af3-4142-ad65-29c7ac808ee1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.170312 Jun 21 16:52:55.960115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 260/500] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:55 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:55.977550 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f9669463-f8c8-40dd-a44c-86189deeaf69 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:55.985611 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f9669463-f8c8-40dd-a44c-86189deeaf69 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1725 microversion: 2.1 time: 0.168209 Jun 21 16:52:55.986182 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 241/501] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:55 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:56.976818 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9105aa6c-f080-4879-bdbf-71d72459d45c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:56.977426 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9105aa6c-f080-4879-bdbf-71d72459d45c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:56.984096 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9105aa6c-f080-4879-bdbf-71d72459d45c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:56.984533 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9105aa6c-f080-4879-bdbf-71d72459d45c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:56.985319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9105aa6c-f080-4879-bdbf-71d72459d45c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:56.985744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9105aa6c-f080-4879-bdbf-71d72459d45c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:57.003607 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-010c7c23-63d7-4be9-81c6-732293d95cbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:57.008429 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-010c7c23-63d7-4be9-81c6-732293d95cbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:57.011560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-010c7c23-63d7-4be9-81c6-732293d95cbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:57.012081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-010c7c23-63d7-4be9-81c6-732293d95cbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:57.012922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-010c7c23-63d7-4be9-81c6-732293d95cbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:57.013464 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-010c7c23-63d7-4be9-81c6-732293d95cbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:57.127518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9105aa6c-f080-4879-bdbf-71d72459d45c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:57.135657 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9105aa6c-f080-4879-bdbf-71d72459d45c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.163232 Jun 21 16:52:57.136681 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 261/502] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:56 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:57.148018 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-010c7c23-63d7-4be9-81c6-732293d95cbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:57.155897 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-010c7c23-63d7-4be9-81c6-732293d95cbe tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1731 microversion: 2.1 time: 0.156323 Jun 21 16:52:57.156481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 242/503] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:56 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:52:57.172636 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-98c910ba-e970-4690-b014-71538f8ec41a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:57.173200 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-98c910ba-e970-4690-b014-71538f8ec41a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:57.180938 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-98c910ba-e970-4690-b014-71538f8ec41a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:57.181526 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-98c910ba-e970-4690-b014-71538f8ec41a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:57.182306 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-98c910ba-e970-4690-b014-71538f8ec41a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:57.182741 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-98c910ba-e970-4690-b014-71538f8ec41a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:57.262267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-98c910ba-e970-4690-b014-71538f8ec41a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093665 Jun 21 16:52:57.262856 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 262/504] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 16:52:57 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:57.433387 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-9da6f73c-cbdd-45ca-a0b5-95a80f9d4ea1 req-29f86b39-6a73-4433-8054-49992dd0cda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff16739-f953-4e6d-9c9c-c283d8ed7c33", "name": "network-vif-plugged", "status": "completed", "tag": "3b782323-0e20-4ed4-9fde-029d430c7e0e"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:57.441959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-9da6f73c-cbdd-45ca-a0b5-95a80f9d4ea1 req-29f86b39-6a73-4433-8054-49992dd0cda6 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:57.442403 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-9da6f73c-cbdd-45ca-a0b5-95a80f9d4ea1 req-29f86b39-6a73-4433-8054-49992dd0cda6 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:57.454363 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-9da6f73c-cbdd-45ca-a0b5-95a80f9d4ea1 req-29f86b39-6a73-4433-8054-49992dd0cda6 service nova] Creating event network-vif-plugged:3b782323-0e20-4ed4-9fde-029d430c7e0e for instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 on hv-cinder-79987 Jun 21 16:52:57.459860 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-9da6f73c-cbdd-45ca-a0b5-95a80f9d4ea1 req-29f86b39-6a73-4433-8054-49992dd0cda6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030226 Jun 21 16:52:57.464319 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 243/505] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:58.153148 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-dcc4f696-e985-4471-b325-14dc08914926 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:58.153845 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-dcc4f696-e985-4471-b325-14dc08914926 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:58.159830 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dcc4f696-e985-4471-b325-14dc08914926 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:58.160341 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dcc4f696-e985-4471-b325-14dc08914926 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:58.161112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dcc4f696-e985-4471-b325-14dc08914926 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:58.162461 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dcc4f696-e985-4471-b325-14dc08914926 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:58.306195 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-dcc4f696-e985-4471-b325-14dc08914926 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:58.313769 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-dcc4f696-e985-4471-b325-14dc08914926 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.165307 Jun 21 16:52:58.314331 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 263/506] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:58 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:52:58.538081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-903b2503-77d5-4d64-9c23-10bc6c715c78 req-cfeed299-7975-4db3-ae6b-f9b38dffb3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd85d90-a058-4a02-b0c5-acde031fa94f", "tag": "205be5db-3ab1-4914-b8b3-31b16386f2c6"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:52:58.546959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-903b2503-77d5-4d64-9c23-10bc6c715c78 req-cfeed299-7975-4db3-ae6b-f9b38dffb3de service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:58.547411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-903b2503-77d5-4d64-9c23-10bc6c715c78 req-cfeed299-7975-4db3-ae6b-f9b38dffb3de service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:58.559890 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-903b2503-77d5-4d64-9c23-10bc6c715c78 req-cfeed299-7975-4db3-ae6b-f9b38dffb3de service nova] Creating event network-changed:205be5db-3ab1-4914-b8b3-31b16386f2c6 for instance 7bd85d90-a058-4a02-b0c5-acde031fa94f on hv-cinder-79987 Jun 21 16:52:58.568471 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-903b2503-77d5-4d64-9c23-10bc6c715c78 req-cfeed299-7975-4db3-ae6b-f9b38dffb3de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034476 Jun 21 16:52:58.569216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 244/507] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:52:59.329838 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-527954ad-dc17-4d93-ba3c-c9073acf94eb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:52:59.330543 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-527954ad-dc17-4d93-ba3c-c9073acf94eb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:52:59.337380 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-527954ad-dc17-4d93-ba3c-c9073acf94eb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:59.339801 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-527954ad-dc17-4d93-ba3c-c9073acf94eb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:59.339801 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-527954ad-dc17-4d93-ba3c-c9073acf94eb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:52:59.339801 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-527954ad-dc17-4d93-ba3c-c9073acf94eb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:52:59.480962 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-527954ad-dc17-4d93-ba3c-c9073acf94eb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:52:59.488645 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-527954ad-dc17-4d93-ba3c-c9073acf94eb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1266 microversion: 2.1 time: 0.162840 Jun 21 16:52:59.489224 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 264/508] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:52:59 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:00.002272 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d284b4cc-bafe-41ee-bcab-8ab90e30faa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:00.003015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d284b4cc-bafe-41ee-bcab-8ab90e30faa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:00.010458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d284b4cc-bafe-41ee-bcab-8ab90e30faa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.010912 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d284b4cc-bafe-41ee-bcab-8ab90e30faa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.011672 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d284b4cc-bafe-41ee-bcab-8ab90e30faa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.012109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d284b4cc-bafe-41ee-bcab-8ab90e30faa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.039874 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d284b4cc-bafe-41ee-bcab-8ab90e30faa1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments/3355213d-c38a-4496-953d-f0d6d0e8b862" status: 200 len: 194 microversion: 2.20 time: 0.042520 Jun 21 16:53:00.040447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 245/509] 10.222.0.70 () {60 vars in 1453 bytes} [Tue Jun 21 16:52:59 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments/3355213d-c38a-4496-953d-f0d6d0e8b862 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:53:00.106745 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-dd5c623d-5fed-41a5-b56d-1e66ce6de8c8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:00.107253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-dd5c623d-5fed-41a5-b56d-1e66ce6de8c8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:00.113490 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd5c623d-5fed-41a5-b56d-1e66ce6de8c8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.113935 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd5c623d-5fed-41a5-b56d-1e66ce6de8c8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.115203 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd5c623d-5fed-41a5-b56d-1e66ce6de8c8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.116312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-dd5c623d-5fed-41a5-b56d-1e66ce6de8c8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.249963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-dd5c623d-5fed-41a5-b56d-1e66ce6de8c8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lazy-loading 'services' on Instance uuid 0d9af742-a7f3-4113-8ace-571502dad309 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:53:00.506276 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8abd87dd-b0d2-4783-bdff-90daae41e8aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:00.506878 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8abd87dd-b0d2-4783-bdff-90daae41e8aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:00.512950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8abd87dd-b0d2-4783-bdff-90daae41e8aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.513427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8abd87dd-b0d2-4783-bdff-90daae41e8aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.514172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8abd87dd-b0d2-4783-bdff-90daae41e8aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.514590 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8abd87dd-b0d2-4783-bdff-90daae41e8aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.519734 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-dd5c623d-5fed-41a5-b56d-1e66ce6de8c8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments/3355213d-c38a-4496-953d-f0d6d0e8b862" status: 202 len: 0 microversion: 2.20 time: 0.416819 Jun 21 16:53:00.520331 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 265/510] 10.222.0.70 () {60 vars in 1456 bytes} [Tue Jun 21 16:53:00 2022] DELETE /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments/3355213d-c38a-4496-953d-f0d6d0e8b862 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:53:00.531963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7fac0428-1cfd-4248-a4a4-99f26c2e97a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:00.531963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7fac0428-1cfd-4248-a4a4-99f26c2e97a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:00.537546 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fac0428-1cfd-4248-a4a4-99f26c2e97a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.537993 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fac0428-1cfd-4248-a4a4-99f26c2e97a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.538905 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fac0428-1cfd-4248-a4a4-99f26c2e97a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.539347 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fac0428-1cfd-4248-a4a4-99f26c2e97a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.573720 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7fac0428-1cfd-4248-a4a4-99f26c2e97a1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048780 Jun 21 16:53:00.574292 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 266/511] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jun 21 16:53:00 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:53:00.595255 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-c03390e4-500e-4204-8ffe-193f7c55bb95 req-936b7eed-c188-4c22-b72f-3d9080993008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd85d90-a058-4a02-b0c5-acde031fa94f", "tag": "205be5db-3ab1-4914-b8b3-31b16386f2c6"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:00.604462 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-c03390e4-500e-4204-8ffe-193f7c55bb95 req-936b7eed-c188-4c22-b72f-3d9080993008 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.604911 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-c03390e4-500e-4204-8ffe-193f7c55bb95 req-936b7eed-c188-4c22-b72f-3d9080993008 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.616453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-c03390e4-500e-4204-8ffe-193f7c55bb95 req-936b7eed-c188-4c22-b72f-3d9080993008 service nova] Creating event network-changed:205be5db-3ab1-4914-b8b3-31b16386f2c6 for instance 7bd85d90-a058-4a02-b0c5-acde031fa94f on hv-cinder-79987 Jun 21 16:53:00.621743 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-c03390e4-500e-4204-8ffe-193f7c55bb95 req-936b7eed-c188-4c22-b72f-3d9080993008 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030006 Jun 21 16:53:00.622731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 267/512] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:53:00.685424 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8abd87dd-b0d2-4783-bdff-90daae41e8aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:00.694178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8abd87dd-b0d2-4783-bdff-90daae41e8aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1453 microversion: 2.1 time: 0.191947 Jun 21 16:53:00.694845 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 246/513] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:00 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:53:00.714976 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b324b5ba-f403-478f-b961-104c90d4e105 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:00.714976 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b324b5ba-f403-478f-b961-104c90d4e105 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:00.721084 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b324b5ba-f403-478f-b961-104c90d4e105 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.721628 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b324b5ba-f403-478f-b961-104c90d4e105 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.722443 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b324b5ba-f403-478f-b961-104c90d4e105 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:00.722874 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b324b5ba-f403-478f-b961-104c90d4e105 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:00.859859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b324b5ba-f403-478f-b961-104c90d4e105 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:00.867864 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b324b5ba-f403-478f-b961-104c90d4e105 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1453 microversion: 2.1 time: 0.160614 Jun 21 16:53:00.868413 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 268/514] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:00 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:01.586362 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8c96bb03-385f-463d-9e27-48080daaad1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:01.587436 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8c96bb03-385f-463d-9e27-48080daaad1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:01.594041 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8c96bb03-385f-463d-9e27-48080daaad1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:01.594591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8c96bb03-385f-463d-9e27-48080daaad1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:01.595406 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8c96bb03-385f-463d-9e27-48080daaad1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:01.596013 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8c96bb03-385f-463d-9e27-48080daaad1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:01.627349 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8c96bb03-385f-463d-9e27-48080daaad1f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045663 Jun 21 16:53:01.627995 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 247/515] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jun 21 16:53:01 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:53:02.640066 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fb205d44-09bb-4659-a9e9-42f2123e1d21 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:02.641882 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fb205d44-09bb-4659-a9e9-42f2123e1d21 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:02.647707 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fb205d44-09bb-4659-a9e9-42f2123e1d21 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:02.648155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fb205d44-09bb-4659-a9e9-42f2123e1d21 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:02.648914 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fb205d44-09bb-4659-a9e9-42f2123e1d21 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:02.649379 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fb205d44-09bb-4659-a9e9-42f2123e1d21 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:02.653174 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:02.679532 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fb205d44-09bb-4659-a9e9-42f2123e1d21 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043120 Jun 21 16:53:02.680001 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 269/516] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jun 21 16:53:02 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:02.741102 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-20e6f337-498c-40f1-aa16-4b1f2abdbf3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:02.741636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-20e6f337-498c-40f1-aa16-4b1f2abdbf3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:02.748568 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-20e6f337-498c-40f1-aa16-4b1f2abdbf3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:02.749033 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-20e6f337-498c-40f1-aa16-4b1f2abdbf3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:02.749855 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-20e6f337-498c-40f1-aa16-4b1f2abdbf3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:02.750288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-20e6f337-498c-40f1-aa16-4b1f2abdbf3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:02.775616 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-20e6f337-498c-40f1-aa16-4b1f2abdbf3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:53:03.033821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-55da08a7-30ac-43d2-837a-349328d41118 req-4934fc1b-f657-4d6e-8759-08bcb2a77573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff16739-f953-4e6d-9c9c-c283d8ed7c33", "tag": "3b782323-0e20-4ed4-9fde-029d430c7e0e"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:03.043788 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-55da08a7-30ac-43d2-837a-349328d41118 req-4934fc1b-f657-4d6e-8759-08bcb2a77573 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:03.044227 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-55da08a7-30ac-43d2-837a-349328d41118 req-4934fc1b-f657-4d6e-8759-08bcb2a77573 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:03.057654 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-55da08a7-30ac-43d2-837a-349328d41118 req-4934fc1b-f657-4d6e-8759-08bcb2a77573 service nova] Creating event network-changed:3b782323-0e20-4ed4-9fde-029d430c7e0e for instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 on hv-cinder-79987 Jun 21 16:53:03.062521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-55da08a7-30ac-43d2-837a-349328d41118 req-4934fc1b-f657-4d6e-8759-08bcb2a77573 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033352 Jun 21 16:53:03.065889 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 270/517] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:53:03.138937 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-20e6f337-498c-40f1-aa16-4b1f2abdbf3d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 204 len: 0 microversion: 2.20 time: 0.402316 Jun 21 16:53:03.139949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 248/518] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jun 21 16:53:02 2022] DELETE /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 16:53:03.149466 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:03.150345 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:03.157494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:03.158053 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:03.158831 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:03.159266 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:03.296713 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:03.303123 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:03.304973 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:03.306166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-93cc0d40-b2cd-46de-9944-a09e4345baee tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.161650 Jun 21 16:53:03.306941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 271/519] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:03 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:53:04.326079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:04.326874 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:04.333214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:04.334248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:04.335193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:04.335621 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:04.469671 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:04.477881 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:04.479394 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:04.480539 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e1657c35-bebf-4917-9422-b02c8398ca60 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.158708 Jun 21 16:53:04.481096 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 249/520] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:04 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:05.499551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:05.500265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:05.507770 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:05.508260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:05.509028 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:05.509508 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:05.649545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:05.657782 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:05.659277 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:05.660420 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2eaa10eb-5e8f-4f5e-9b74-b4abea30e6fb tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1723 microversion: 2.20 time: 0.164809 Jun 21 16:53:05.660977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 272/521] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:05 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:06.172954 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-87e9c769-839d-4368-9f82-1049b092d6b0 req-9f508ba5-518f-483b-890d-8be5e671cdfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9af742-a7f3-4113-8ace-571502dad309", "name": "network-vif-deleted", "tag": "7b305906-1977-410d-88f8-b281cb089050"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:06.184962 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-87e9c769-839d-4368-9f82-1049b092d6b0 req-9f508ba5-518f-483b-890d-8be5e671cdfa service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:06.199079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-87e9c769-839d-4368-9f82-1049b092d6b0 req-9f508ba5-518f-483b-890d-8be5e671cdfa service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:06.199079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-87e9c769-839d-4368-9f82-1049b092d6b0 req-9f508ba5-518f-483b-890d-8be5e671cdfa service nova] Creating event network-vif-deleted:7b305906-1977-410d-88f8-b281cb089050 for instance 0d9af742-a7f3-4113-8ace-571502dad309 on hv-cinder-79987 Jun 21 16:53:06.202508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-87e9c769-839d-4368-9f82-1049b092d6b0 req-9f508ba5-518f-483b-890d-8be5e671cdfa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034012 Jun 21 16:53:06.203257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 250/522] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:53:06.680147 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:06.680757 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:06.687423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:06.687870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:06.688762 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:06.689196 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:06.724434 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:06.726089 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:06.726089 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lazy-loading 'fault' on Instance uuid 0d9af742-a7f3-4113-8ace-571502dad309 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:53:06.772861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:06.782443 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:06.784196 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:06.785477 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-658e963e-534c-4852-8b0d-9b8d9a1ee82f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 200 len: 1371 microversion: 2.20 time: 0.109540 Jun 21 16:53:06.786106 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 273/523] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:06 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:07.805642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:07.806342 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:07.812637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:07.813074 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:07.813861 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:07.814288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:07.827399 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] HTTP exception thrown: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Request method failure captured: Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 HTTP/1.1 Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZoo8geCpQCOPxdA1NwCVLYpOf8L8zNo6xPB2FCi3E4WgEGKj9OFYT0K1skwIv0nf46OpevxD4xxg_MuNbosCgyfNH0OlvhllmEUBF5OtccnI5vPvjdLgVAgFpm75lkUX2B2Fynuz_ck2oP3HaoZKL1xm0ufsksS8tihXhsyo3puRg Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:53:07.829030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cd0d0402244286b9199e77f8ef18ca", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: a25a52e592a34cd48a8c88304501c047 Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:53:07.830724 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '0d9af742-a7f3-4113-8ace-571502dad309'} Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:53:07.831721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:53:07.833241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:53:07.835109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Returning 404 to user: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:53:07.835109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1b2eac3e-0bf2-4a46-87f6-19b22df76e2a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 404 len: 111 microversion: 2.20 time: 0.030546 Jun 21 16:53:07.835109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 251/524] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:07 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:53:07.839732 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f3e944ea-8e7a-434c-9918-7d4b6499912c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '.version_select at 0x7f0a42aad820>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:07.922638 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f3e944ea-8e7a-434c-9918-7d4b6499912c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460699218" status: 204 len: 0 microversion: 2.20 time: 0.087009 Jun 21 16:53:07.923223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 274/525] 10.222.0.70 () {60 vars in 1258 bytes} [Tue Jun 21 16:53:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460699218 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 16:53:08.974130 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d880b9d4-1441-4ab7-9367-cdd8ec5bf203 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'create', calling method: .version_select at 0x7f0a42a561f0>, body: {"keypair": {"name": "tempest-keypair-1615291646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgkCZ7Lv4wRmqHVLPhlW2diax36WF6M8edAyK2OZXaNa88YsJRQqdIaSmLPI3R8HvHw//A+x0CbLsPdHqGx8OIavRG2o6UZEModcq+RKebowAuZ+xPMIQi1k5yQekTEhA=="}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:08.990643 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-d880b9d4-1441-4ab7-9367-cdd8ec5bf203 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Getting quotas for project 85cd0d0402244286b9199e77f8ef18ca. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:53:08.993445 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-d880b9d4-1441-4ab7-9367-cdd8ec5bf203 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Getting quotas for user a25a52e592a34cd48a8c88304501c047 and project 85cd0d0402244286b9199e77f8ef18ca. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:53:09.070248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d880b9d4-1441-4ab7-9367-cdd8ec5bf203 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.099874 Jun 21 16:53:09.070780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 252/526] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jun 21 16:53:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 16:53:11.765649 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1551221160", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8df8015f-3aaf-42f1-8475-cd22b8c0ed19"}], "security_groups": [{"name": "tempest-securitygroup--520537129"}], "key_name": "tempest-keypair-1615291646", "user_data": "}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:11.773885 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:11.868045 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] validate_networks() for [('8df8015f-3aaf-42f1-8475-cd22b8c0ed19', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:53:12.231703 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:53:12.232128 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:53:12.232601 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:53:12.233009 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:53:12.233748 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:53:12.242626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:12.243074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:12.243872 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:12.244310 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:12.262544 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Getting quotas for project 85cd0d0402244286b9199e77f8ef18ca. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:53:12.266618 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Getting quotas for user a25a52e592a34cd48a8c88304501c047 and project 85cd0d0402244286b9199e77f8ef18ca. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:53:12.278292 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:53:12.280545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:53:12.423899 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0b7bef54-16a4-4122-aaea-a915ab6638e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.662444 Jun 21 16:53:12.424465 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 275/527] 10.222.0.70 () {62 vars in 1187 bytes} [Tue Jun 21 16:53:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 16:53:12.437199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a2c7546b-ace8-49b4-8725-d2d6cd4778f6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:12.437949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a2c7546b-ace8-49b4-8725-d2d6cd4778f6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:12.496636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a2c7546b-ace8-49b4-8725-d2d6cd4778f6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:12.504097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a2c7546b-ace8-49b4-8725-d2d6cd4778f6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:12.505710 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a2c7546b-ace8-49b4-8725-d2d6cd4778f6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:12.507439 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a2c7546b-ace8-49b4-8725-d2d6cd4778f6 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1282 microversion: 2.20 time: 0.074856 Jun 21 16:53:12.508001 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 253/528] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:12 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:53:13.526842 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:13.527400 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:13.534235 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:13.534688 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:13.535482 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:13.535924 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:13.602660 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:13.611131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:13.612604 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:13.613703 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-284813ae-3e8d-41f5-8497-c17db245cb95 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1286 microversion: 2.20 time: 0.092092 Jun 21 16:53:13.614620 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 276/529] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:13 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:14.632122 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:14.632909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:14.639767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:14.640270 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:14.641040 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:14.641706 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:14.725997 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:14.734180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:14.735789 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:14.737218 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-44303cf6-cfc2-48b9-aa94-f41f1efc49c4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1342 microversion: 2.20 time: 0.109102 Jun 21 16:53:14.738004 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 254/530] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:14 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1342 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:15.756116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:15.756833 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:15.763631 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:15.764190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:15.764951 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:15.765417 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:15.908649 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:15.917602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:15.919144 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:15.920232 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4d6e891e-9edc-4c99-aa01-51d6e6941f4d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1407 microversion: 2.20 time: 0.168190 Jun 21 16:53:15.920789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 277/531] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:15 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:16.398604 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-e25fe053-1ef4-4e0f-a9eb-8702c833e190 req-02837da3-3d41-4c41-bc28-c3d0cd19f424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a46d00d-8f66-43bf-990b-e31ab81b9ae0", "tag": "9422fb6f-a2be-40f8-9c46-eb984da56a96"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:16.405684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:16.409816 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-e25fe053-1ef4-4e0f-a9eb-8702c833e190 req-02837da3-3d41-4c41-bc28-c3d0cd19f424 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:16.411060 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-e25fe053-1ef4-4e0f-a9eb-8702c833e190 req-02837da3-3d41-4c41-bc28-c3d0cd19f424 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:16.423779 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-e25fe053-1ef4-4e0f-a9eb-8702c833e190 req-02837da3-3d41-4c41-bc28-c3d0cd19f424 service nova] Creating event network-changed:9422fb6f-a2be-40f8-9c46-eb984da56a96 for instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 on hv-cinder-79987 Jun 21 16:53:16.429185 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-e25fe053-1ef4-4e0f-a9eb-8702c833e190 req-02837da3-3d41-4c41-bc28-c3d0cd19f424 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035810 Jun 21 16:53:16.435091 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 255/532] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:53:16.938719 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:16.939402 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:16.946635 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:16.946931 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:16.947690 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:16.948122 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:17.081395 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:17.089955 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:17.091444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:17.092532 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fc243e5d-2b12-45dc-94ad-ae045fc9828a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1407 microversion: 2.20 time: 0.157727 Jun 21 16:53:17.093091 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 278/533] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:16 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:18.110825 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:18.111558 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:18.119306 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:18.130454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:18.130454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:18.130454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:18.256849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:18.265137 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:18.266720 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:18.267826 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e0594b64-5642-4296-ae27-124cf29a8f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1407 microversion: 2.20 time: 0.161648 Jun 21 16:53:18.268381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 256/534] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:18 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:19.285800 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:19.286399 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:19.293355 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:19.293809 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:19.294576 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:19.295011 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:19.430987 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:19.438951 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:19.440461 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:19.441572 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3e8eb601-ef84-4d89-be54-5211f0035ed2 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1407 microversion: 2.20 time: 0.159661 Jun 21 16:53:19.442129 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 279/535] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:19 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:20.460888 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:20.461505 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:20.468008 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:20.468440 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:20.469190 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:20.469647 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:20.600422 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:20.608381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:20.609921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:20.611008 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5fa9d456-9a65-4781-8d67-384ea53db67e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1407 microversion: 2.20 time: 0.154945 Jun 21 16:53:20.611553 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 257/536] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:20 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:21.464359 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-0e55e095-bc8d-4efb-ad95-7ceff14e316c req-15ca2403-90e2-4598-8738-11301004301c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a46d00d-8f66-43bf-990b-e31ab81b9ae0", "name": "network-vif-plugged", "status": "completed", "tag": "9422fb6f-a2be-40f8-9c46-eb984da56a96"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:21.472908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-0e55e095-bc8d-4efb-ad95-7ceff14e316c req-15ca2403-90e2-4598-8738-11301004301c service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:21.473384 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-0e55e095-bc8d-4efb-ad95-7ceff14e316c req-15ca2403-90e2-4598-8738-11301004301c service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:21.485303 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-0e55e095-bc8d-4efb-ad95-7ceff14e316c req-15ca2403-90e2-4598-8738-11301004301c service nova] Creating event network-vif-plugged:9422fb6f-a2be-40f8-9c46-eb984da56a96 for instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 on hv-cinder-79987 Jun 21 16:53:21.495568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-0e55e095-bc8d-4efb-ad95-7ceff14e316c req-15ca2403-90e2-4598-8738-11301004301c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029511 Jun 21 16:53:21.495568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 280/537] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:53:21.629849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:21.630483 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:21.637450 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:21.637920 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:21.638725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:21.639157 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:21.643315 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:21.772406 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:21.780738 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:21.782594 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:21.783475 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8cac4eff-07c8-4e9a-a078-3e114f99b2d3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1407 microversion: 2.20 time: 0.157536 Jun 21 16:53:21.784030 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 258/538] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:21 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:22.799479 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:22.800175 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=6 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:22.805444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:22.806169 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:22.812335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:22.812784 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:22.813568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:22.814005 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:22.949631 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:22.957729 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:22.959218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:22.960598 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8e5fd859-e7ff-47ac-8576-e8430b3a4c9a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1407 microversion: 2.20 time: 0.162126 Jun 21 16:53:22.961166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 281/539] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:22 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:23.980146 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:23.980952 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:23.982582 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=6 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:23.988051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:23.988506 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:23.989262 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:23.989726 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:24.124930 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:24.133206 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:24.134729 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:24.135835 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f0e31842-29de-4743-a89b-9037b4f22e71 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1407 microversion: 2.20 time: 0.161136 Jun 21 16:53:24.136377 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 259/540] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:23 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:25.153909 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:25.154507 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:25.160946 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:25.161425 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:25.162180 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:25.163129 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:25.296407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:25.304982 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:25.306509 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:25.307645 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9cb35a92-9572-43a8-8ae8-3c9fe0a69469 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1600 microversion: 2.20 time: 0.157657 Jun 21 16:53:25.308195 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 282/541] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:53:25 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:53:25.324825 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-64ad927f-cda3-40a6-b92f-bf9cfa04f1c1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:25.325399 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-64ad927f-cda3-40a6-b92f-bf9cfa04f1c1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:25.332126 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-64ad927f-cda3-40a6-b92f-bf9cfa04f1c1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:25.332590 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-64ad927f-cda3-40a6-b92f-bf9cfa04f1c1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:25.333356 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-64ad927f-cda3-40a6-b92f-bf9cfa04f1c1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:25.333788 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-64ad927f-cda3-40a6-b92f-bf9cfa04f1c1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:25.414412 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-64ad927f-cda3-40a6-b92f-bf9cfa04f1c1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093428 Jun 21 16:53:25.415007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 260/542] 10.222.0.70 () {60 vars in 1315 bytes} [Tue Jun 21 16:53:25 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:53:26.399653 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-cde5106a-7af7-4746-a225-2f3f2f67b90c req-f3783f53-a7ca-4dba-89b1-73bf28bfd98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a46d00d-8f66-43bf-990b-e31ab81b9ae0", "tag": "9422fb6f-a2be-40f8-9c46-eb984da56a96"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:26.408170 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-cde5106a-7af7-4746-a225-2f3f2f67b90c req-f3783f53-a7ca-4dba-89b1-73bf28bfd98f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:26.408684 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-cde5106a-7af7-4746-a225-2f3f2f67b90c req-f3783f53-a7ca-4dba-89b1-73bf28bfd98f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:26.419768 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-cde5106a-7af7-4746-a225-2f3f2f67b90c req-f3783f53-a7ca-4dba-89b1-73bf28bfd98f service nova] Creating event network-changed:9422fb6f-a2be-40f8-9c46-eb984da56a96 for instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 on hv-cinder-79987 Jun 21 16:53:26.424856 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-cde5106a-7af7-4746-a225-2f3f2f67b90c req-f3783f53-a7ca-4dba-89b1-73bf28bfd98f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028948 Jun 21 16:53:26.425783 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 283/543] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:53:41.860057 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=11 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:41.860811 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=15 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:41.864683 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-128eae67-484a-418f-94b9-d1c38adc8301 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:41.865701 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-128eae67-484a-418f-94b9-d1c38adc8301 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:41.872064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-128eae67-484a-418f-94b9-d1c38adc8301 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:41.872762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-128eae67-484a-418f-94b9-d1c38adc8301 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:41.873537 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-128eae67-484a-418f-94b9-d1c38adc8301 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:41.873964 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-128eae67-484a-418f-94b9-d1c38adc8301 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:41.903644 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-128eae67-484a-418f-94b9-d1c38adc8301 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044874 Jun 21 16:53:41.904519 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 261/544] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:53:41 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:53:41.960829 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:41.961600 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=68 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:53:41.965543 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0210b471-c570-443e-a836-63cad1b8ed2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:41.966118 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0210b471-c570-443e-a836-63cad1b8ed2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:41.972167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0210b471-c570-443e-a836-63cad1b8ed2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:41.973305 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0210b471-c570-443e-a836-63cad1b8ed2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:41.973425 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0210b471-c570-443e-a836-63cad1b8ed2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:41.973856 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0210b471-c570-443e-a836-63cad1b8ed2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:42.000216 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0210b471-c570-443e-a836-63cad1b8ed2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Going to try to terminate instance {{(pid=124685) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:53:42.286127 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0210b471-c570-443e-a836-63cad1b8ed2a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 204 len: 0 microversion: 2.1 time: 0.327016 Jun 21 16:53:42.286712 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 284/545] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:53:41 2022] DELETE /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:53:42.295588 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5ca950eb-583a-46d9-b3bc-fa393e93886a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:42.296201 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5ca950eb-583a-46d9-b3bc-fa393e93886a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:42.302679 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5ca950eb-583a-46d9-b3bc-fa393e93886a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:42.303132 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5ca950eb-583a-46d9-b3bc-fa393e93886a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:42.304507 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5ca950eb-583a-46d9-b3bc-fa393e93886a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:42.305120 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5ca950eb-583a-46d9-b3bc-fa393e93886a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:42.492159 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5ca950eb-583a-46d9-b3bc-fa393e93886a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:42.499974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5ca950eb-583a-46d9-b3bc-fa393e93886a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1673 microversion: 2.1 time: 0.208536 Jun 21 16:53:42.500531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 262/546] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:42 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:43.517967 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-68683c99-d068-4174-90be-4df54dfb571c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:43.518718 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-68683c99-d068-4174-90be-4df54dfb571c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:43.525554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-68683c99-d068-4174-90be-4df54dfb571c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:43.526008 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-68683c99-d068-4174-90be-4df54dfb571c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:43.526769 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-68683c99-d068-4174-90be-4df54dfb571c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:43.527208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-68683c99-d068-4174-90be-4df54dfb571c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:43.708531 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-68683c99-d068-4174-90be-4df54dfb571c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:43.716093 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-68683c99-d068-4174-90be-4df54dfb571c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1673 microversion: 2.1 time: 0.202482 Jun 21 16:53:43.716659 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 285/547] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:43 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1673 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:44.734027 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fca300c0-4490-4fd7-86f7-fd637530a35b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:44.734644 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-fca300c0-4490-4fd7-86f7-fd637530a35b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:44.741085 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fca300c0-4490-4fd7-86f7-fd637530a35b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:44.741563 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fca300c0-4490-4fd7-86f7-fd637530a35b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:44.742326 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fca300c0-4490-4fd7-86f7-fd637530a35b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:44.742932 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fca300c0-4490-4fd7-86f7-fd637530a35b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:44.974978 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fca300c0-4490-4fd7-86f7-fd637530a35b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:44.982869 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fca300c0-4490-4fd7-86f7-fd637530a35b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1673 microversion: 2.1 time: 0.253872 Jun 21 16:53:44.983426 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 263/548] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:44 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1673 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:45.703504 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-5ecad036-db16-4094-bd2e-56c28ebfce9a req-b82a707b-fc77-4cd5-b1f6-d6315b0f9869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f605003b-48fd-4e3f-9f19-462e7b713558", "name": "network-vif-deleted", "tag": "a340b6f8-fea6-4847-a4cd-7d1ef896ed71"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:45.713237 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-5ecad036-db16-4094-bd2e-56c28ebfce9a req-b82a707b-fc77-4cd5-b1f6-d6315b0f9869 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:45.713700 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-5ecad036-db16-4094-bd2e-56c28ebfce9a req-b82a707b-fc77-4cd5-b1f6-d6315b0f9869 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:45.725107 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-5ecad036-db16-4094-bd2e-56c28ebfce9a req-b82a707b-fc77-4cd5-b1f6-d6315b0f9869 service nova] Creating event network-vif-deleted:a340b6f8-fea6-4847-a4cd-7d1ef896ed71 for instance f605003b-48fd-4e3f-9f19-462e7b713558 on hv-cinder-79987 Jun 21 16:53:45.730802 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-5ecad036-db16-4094-bd2e-56c28ebfce9a req-b82a707b-fc77-4cd5-b1f6-d6315b0f9869 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031094 Jun 21 16:53:45.731501 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 286/549] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:53:46.000592 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:46.001867 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:46.010083 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:46.010526 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:46.011500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:46.012021 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:46.044927 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:46.045295 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:46.045764 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lazy-loading 'fault' on Instance uuid f605003b-48fd-4e3f-9f19-462e7b713558 {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:53:46.089198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:46.096921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-292b1800-1d1f-4aba-8f80-380fc5a33c22 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 200 len: 1328 microversion: 2.1 time: 0.100797 Jun 21 16:53:46.097666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 264/550] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:45 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:47.114884 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:47.115568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:47.123446 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:47.123893 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:47.124649 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:47.125081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:47.142861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] HTTP exception thrown: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Request method failure captured: Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 HTTP/1.1 Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZpV8W35e9XU2-fZVSYZl3vp-PX0Tkc4yTDs4toeioH_WmZVgU5lNMHmX5vQQOHwzWZeXXDSjNkcsa9PFrAjsgerhrRcOGDjncH3nXkjBwOIv9j0IpBY8EOcBXUvjkSvdCcvOEGJAbtxlfmtG28ymzQD8dC5EEKRP1WDLKJLKJ0KoY Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:53:47.144471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0a35c2bcb0e44e0ab3751a83635424e8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 52ad18360dc64d2ea85cc950c9daa723 Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:53:47.146242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': 'f605003b-48fd-4e3f-9f19-462e7b713558'} Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:53:47.147145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:53:47.148803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:53:47.150244 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Returning 404 to user: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:53:47.150244 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-68fb20c5-56c4-44e1-a853-44df8c5f287b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 404 len: 111 microversion: 2.1 time: 0.035268 Jun 21 16:53:47.150244 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 287/551] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:47 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:53:47.155020 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-345cc612-d09a-433b-8c2d-96cce67a6250 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '.version_select at 0x7f0a42a564c0>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:47.248268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-345cc612-d09a-433b-8c2d-96cce67a6250 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857301077" status: 202 len: 0 microversion: 2.1 time: 0.096691 Jun 21 16:53:47.248863 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 265/552] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jun 21 16:53:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857301077 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:53:48.100049 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f8dd11ca-6316-4ccd-b216-e8431b5f44b1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'create', calling method: .version_select at 0x7f0a42aab280>, body: {"keypair": {"name": "tempest-keypair-704292400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcZX35PSI7cpteyulYf8SnW3YXxx0ONYE1sJVrFSuLwJiS3qdU1A1wMPEu9gEI07GnUiWE1r38m3niCFeTkUFwr5RUXM69/beHZc7CCmFxtMnL6+8fI4P2Jd7rP87GfSg=="}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:48.114418 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-f8dd11ca-6316-4ccd-b216-e8431b5f44b1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Getting quotas for project 0a35c2bcb0e44e0ab3751a83635424e8. Resources: {'key_pairs'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:53:48.118368 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-f8dd11ca-6316-4ccd-b216-e8431b5f44b1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Getting quotas for user 52ad18360dc64d2ea85cc950c9daa723 and project 0a35c2bcb0e44e0ab3751a83635424e8. Resources: {'key_pairs'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:53:48.207025 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f8dd11ca-6316-4ccd-b216-e8431b5f44b1 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110797 Jun 21 16:53:48.207612 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 288/553] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 16:53:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:53:50.413971 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-725705970", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63924b26-7bc3-4fc5-bf40-93746d4a252a"}], "security_groups": [{"name": "tempest-securitygroup--522636398"}], "key_name": "tempest-keypair-704292400", "user_data": "}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:50.516244 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.network.neutron [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] validate_networks() for [('63924b26-7bc3-4fc5-bf40-93746d4a252a', None, None, None, None, None)] {{(pid=124686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:53:50.927767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Flavor limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:53:50.928191 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Image limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:53:50.928661 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Flavor pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:53:50.929069 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Image pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:53:50.929513 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:53:50.938579 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:50.939026 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:50.940202 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:50.940643 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:50.959526 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Getting quotas for project 0a35c2bcb0e44e0ab3751a83635424e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:53:50.964116 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Getting quotas for user 52ad18360dc64d2ea85cc950c9daa723 and project 0a35c2bcb0e44e0ab3751a83635424e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:53:50.975560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Going to run 1 instances... {{(pid=124686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:53:50.978220 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:53:51.193969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b1c8f8fa-c201-47c9-a7a2-ec75fc74ba88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.784272 Jun 21 16:53:51.194572 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 266/554] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:53:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:53:51.205077 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e22b8e33-e342-4497-b03a-b770bedb050a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:51.205719 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e22b8e33-e342-4497-b03a-b770bedb050a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:51.269714 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e22b8e33-e342-4497-b03a-b770bedb050a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:51.279794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e22b8e33-e342-4497-b03a-b770bedb050a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1236 microversion: 2.1 time: 0.078375 Jun 21 16:53:51.280361 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 289/555] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:51 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:52.297034 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1584d854-7c7b-49db-a9fe-afbef4596265 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:52.297668 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1584d854-7c7b-49db-a9fe-afbef4596265 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:52.305196 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1584d854-7c7b-49db-a9fe-afbef4596265 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:52.305681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1584d854-7c7b-49db-a9fe-afbef4596265 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:52.306451 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1584d854-7c7b-49db-a9fe-afbef4596265 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:52.306955 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1584d854-7c7b-49db-a9fe-afbef4596265 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:52.370134 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1584d854-7c7b-49db-a9fe-afbef4596265 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:52.377908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1584d854-7c7b-49db-a9fe-afbef4596265 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1240 microversion: 2.1 time: 0.085351 Jun 21 16:53:52.378467 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 267/556] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:52 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:53.394540 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-516479f0-da19-4925-aa7f-3dfb16ac4a37 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:53.395147 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-516479f0-da19-4925-aa7f-3dfb16ac4a37 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:53.402513 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-516479f0-da19-4925-aa7f-3dfb16ac4a37 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:53.402958 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-516479f0-da19-4925-aa7f-3dfb16ac4a37 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:53.403728 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-516479f0-da19-4925-aa7f-3dfb16ac4a37 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:53.404159 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-516479f0-da19-4925-aa7f-3dfb16ac4a37 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:53.466800 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-516479f0-da19-4925-aa7f-3dfb16ac4a37 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:53.474511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-516479f0-da19-4925-aa7f-3dfb16ac4a37 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1306 microversion: 2.1 time: 0.083831 Jun 21 16:53:53.474994 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 290/557] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:53 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:54.492182 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8b9785ab-fd43-44c1-bfad-d9c67fd6e724 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:54.492780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8b9785ab-fd43-44c1-bfad-d9c67fd6e724 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:54.501018 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8b9785ab-fd43-44c1-bfad-d9c67fd6e724 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:54.501018 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8b9785ab-fd43-44c1-bfad-d9c67fd6e724 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:54.501709 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8b9785ab-fd43-44c1-bfad-d9c67fd6e724 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:54.502137 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8b9785ab-fd43-44c1-bfad-d9c67fd6e724 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:54.717444 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8b9785ab-fd43-44c1-bfad-d9c67fd6e724 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:54.724871 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8b9785ab-fd43-44c1-bfad-d9c67fd6e724 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1361 microversion: 2.1 time: 0.236835 Jun 21 16:53:54.725473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 268/558] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:54 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:54.951301 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-a688fb07-fa74-457a-8a05-669ebd5b356c req-7fe274c7-c9f4-4b7e-84a6-3437245d4944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ae4eba-c5bd-4271-8d4b-231ffc992e4d", "tag": "be3f7f6a-58a7-460b-adf0-85a4608bba76"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:54.961732 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-a688fb07-fa74-457a-8a05-669ebd5b356c req-7fe274c7-c9f4-4b7e-84a6-3437245d4944 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:54.962231 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-a688fb07-fa74-457a-8a05-669ebd5b356c req-7fe274c7-c9f4-4b7e-84a6-3437245d4944 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:54.976327 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-a688fb07-fa74-457a-8a05-669ebd5b356c req-7fe274c7-c9f4-4b7e-84a6-3437245d4944 service nova] Creating event network-changed:be3f7f6a-58a7-460b-adf0-85a4608bba76 for instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d on hv-cinder-79987 Jun 21 16:53:54.982944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-a688fb07-fa74-457a-8a05-669ebd5b356c req-7fe274c7-c9f4-4b7e-84a6-3437245d4944 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035715 Jun 21 16:53:54.983545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 291/559] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:53:55.742847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e57dc21b-00b6-43f3-a5f6-5fe1b7ecd6cb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:55.744548 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e57dc21b-00b6-43f3-a5f6-5fe1b7ecd6cb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:55.752139 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e57dc21b-00b6-43f3-a5f6-5fe1b7ecd6cb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:55.752590 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e57dc21b-00b6-43f3-a5f6-5fe1b7ecd6cb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:55.753533 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e57dc21b-00b6-43f3-a5f6-5fe1b7ecd6cb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:55.753977 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e57dc21b-00b6-43f3-a5f6-5fe1b7ecd6cb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:55.917235 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e57dc21b-00b6-43f3-a5f6-5fe1b7ecd6cb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:55.926110 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e57dc21b-00b6-43f3-a5f6-5fe1b7ecd6cb tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1361 microversion: 2.1 time: 0.187060 Jun 21 16:53:55.926978 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 269/560] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:55 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:56.945314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-627f789f-a4e5-4a48-8ec5-339aaaa23ba9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:56.945931 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-627f789f-a4e5-4a48-8ec5-339aaaa23ba9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:56.953240 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-627f789f-a4e5-4a48-8ec5-339aaaa23ba9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:56.953723 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-627f789f-a4e5-4a48-8ec5-339aaaa23ba9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:56.954492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-627f789f-a4e5-4a48-8ec5-339aaaa23ba9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:56.954927 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-627f789f-a4e5-4a48-8ec5-339aaaa23ba9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:57.085474 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-627f789f-a4e5-4a48-8ec5-339aaaa23ba9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:57.091052 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-627f789f-a4e5-4a48-8ec5-339aaaa23ba9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1361 microversion: 2.1 time: 0.150003 Jun 21 16:53:57.091722 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 292/561] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:56 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:58.108511 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-58c3bdc4-a270-4320-be62-51488371ebd6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:58.109106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-58c3bdc4-a270-4320-be62-51488371ebd6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:58.115804 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc4-a270-4320-be62-51488371ebd6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:58.116263 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc4-a270-4320-be62-51488371ebd6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:58.117029 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc4-a270-4320-be62-51488371ebd6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:58.117494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-58c3bdc4-a270-4320-be62-51488371ebd6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:58.246898 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-58c3bdc4-a270-4320-be62-51488371ebd6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:58.254540 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-58c3bdc4-a270-4320-be62-51488371ebd6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1361 microversion: 2.1 time: 0.150121 Jun 21 16:53:58.255107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 270/562] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:58 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:59.271510 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-cbde88ef-ed33-4a0f-bb41-3490b28a4519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:53:59.272127 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-cbde88ef-ed33-4a0f-bb41-3490b28a4519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:53:59.279225 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cbde88ef-ed33-4a0f-bb41-3490b28a4519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:59.279709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cbde88ef-ed33-4a0f-bb41-3490b28a4519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:59.280472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cbde88ef-ed33-4a0f-bb41-3490b28a4519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:59.280910 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-cbde88ef-ed33-4a0f-bb41-3490b28a4519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:59.414721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-cbde88ef-ed33-4a0f-bb41-3490b28a4519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:53:59.423335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-cbde88ef-ed33-4a0f-bb41-3490b28a4519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1361 microversion: 2.1 time: 0.155825 Jun 21 16:53:59.423890 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 293/563] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:53:59 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:53:59.669412 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-d2213a8a-ad19-4bbc-b021-c583f925fb28 req-9aa98b19-eae6-4ac9-92d9-7ac8ef4ccea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ae4eba-c5bd-4271-8d4b-231ffc992e4d", "name": "network-vif-plugged", "status": "completed", "tag": "be3f7f6a-58a7-460b-adf0-85a4608bba76"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:53:59.678312 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-d2213a8a-ad19-4bbc-b021-c583f925fb28 req-9aa98b19-eae6-4ac9-92d9-7ac8ef4ccea8 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:53:59.678748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-d2213a8a-ad19-4bbc-b021-c583f925fb28 req-9aa98b19-eae6-4ac9-92d9-7ac8ef4ccea8 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:53:59.691848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-d2213a8a-ad19-4bbc-b021-c583f925fb28 req-9aa98b19-eae6-4ac9-92d9-7ac8ef4ccea8 service nova] Creating event network-vif-plugged:be3f7f6a-58a7-460b-adf0-85a4608bba76 for instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d on hv-cinder-79987 Jun 21 16:53:59.696786 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-d2213a8a-ad19-4bbc-b021-c583f925fb28 req-9aa98b19-eae6-4ac9-92d9-7ac8ef4ccea8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Jun 21 16:53:59.697422 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 271/564] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:54:00.440198 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9157dbf8-3ce9-4e9e-91a3-23d08515f3ec tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:00.440735 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9157dbf8-3ce9-4e9e-91a3-23d08515f3ec tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:00.448135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9157dbf8-3ce9-4e9e-91a3-23d08515f3ec tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:00.448595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9157dbf8-3ce9-4e9e-91a3-23d08515f3ec tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:00.449394 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9157dbf8-3ce9-4e9e-91a3-23d08515f3ec tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:00.449830 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9157dbf8-3ce9-4e9e-91a3-23d08515f3ec tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:00.581820 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9157dbf8-3ce9-4e9e-91a3-23d08515f3ec tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:00.589571 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9157dbf8-3ce9-4e9e-91a3-23d08515f3ec tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1361 microversion: 2.1 time: 0.153406 Jun 21 16:54:00.590136 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 294/565] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:00 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:01.401774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:01.402527 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=6 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:01.406725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-06287546-8a70-4a07-b633-f28f175f7c3a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:01.407426 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-06287546-8a70-4a07-b633-f28f175f7c3a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:01.413493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-06287546-8a70-4a07-b633-f28f175f7c3a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:01.421589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-06287546-8a70-4a07-b633-f28f175f7c3a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:01.421589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-06287546-8a70-4a07-b633-f28f175f7c3a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:01.421589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-06287546-8a70-4a07-b633-f28f175f7c3a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:01.496657 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-06287546-8a70-4a07-b633-f28f175f7c3a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lazy-loading 'services' on Instance uuid 7bd85d90-a058-4a02-b0c5-acde031fa94f {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:54:01.606328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e8f5a7e7-e3cd-4769-834f-d8f564203476 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:01.606925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e8f5a7e7-e3cd-4769-834f-d8f564203476 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:01.608870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=6 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:01.614440 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8f5a7e7-e3cd-4769-834f-d8f564203476 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:01.614879 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8f5a7e7-e3cd-4769-834f-d8f564203476 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:01.615629 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8f5a7e7-e3cd-4769-834f-d8f564203476 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:01.616050 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8f5a7e7-e3cd-4769-834f-d8f564203476 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:01.705950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-06287546-8a70-4a07-b633-f28f175f7c3a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments/5709ebd8-b2d8-4c04-b2f8-9aba27a6ebac" status: 202 len: 0 microversion: 2.1 time: 0.306177 Jun 21 16:54:01.706768 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 272/566] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 16:54:01 2022] DELETE /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments/5709ebd8-b2d8-4c04-b2f8-9aba27a6ebac => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:54:01.715376 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3e10ea01-1333-4dc2-ad78-34b80ac19d37 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:01.716399 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3e10ea01-1333-4dc2-ad78-34b80ac19d37 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:01.723489 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3e10ea01-1333-4dc2-ad78-34b80ac19d37 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:01.723940 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3e10ea01-1333-4dc2-ad78-34b80ac19d37 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:01.724711 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3e10ea01-1333-4dc2-ad78-34b80ac19d37 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:01.725181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3e10ea01-1333-4dc2-ad78-34b80ac19d37 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:01.753426 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e8f5a7e7-e3cd-4769-834f-d8f564203476 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:01.756523 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3e10ea01-1333-4dc2-ad78-34b80ac19d37 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Jun 21 16:54:01.757432 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 273/567] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:54:01 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:54:01.765391 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e8f5a7e7-e3cd-4769-834f-d8f564203476 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1361 microversion: 2.1 time: 0.163314 Jun 21 16:54:01.766075 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 295/568] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:01 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:02.769125 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5208c997-05df-4c54-89e8-e49d26da6a5a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:02.770062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5208c997-05df-4c54-89e8-e49d26da6a5a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:02.777555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5208c997-05df-4c54-89e8-e49d26da6a5a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:02.777998 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5208c997-05df-4c54-89e8-e49d26da6a5a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:02.778763 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5208c997-05df-4c54-89e8-e49d26da6a5a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:02.779307 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5208c997-05df-4c54-89e8-e49d26da6a5a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:02.782270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-99374aee-7bb5-470d-991d-8018528faf82 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:02.782885 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-99374aee-7bb5-470d-991d-8018528faf82 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:02.789426 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99374aee-7bb5-470d-991d-8018528faf82 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:02.789880 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99374aee-7bb5-470d-991d-8018528faf82 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:02.790652 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99374aee-7bb5-470d-991d-8018528faf82 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:02.791839 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-99374aee-7bb5-470d-991d-8018528faf82 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:02.810011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5208c997-05df-4c54-89e8-e49d26da6a5a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Jun 21 16:54:02.810687 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 274/569] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:54:02 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:54:02.931505 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-99374aee-7bb5-470d-991d-8018528faf82 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:02.939394 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-99374aee-7bb5-470d-991d-8018528faf82 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1548 microversion: 2.1 time: 0.160906 Jun 21 16:54:02.939961 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 296/570] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:02 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:02.956054 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0275dcf3-84c6-40c7-b521-a4b473010614 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:02.956544 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0275dcf3-84c6-40c7-b521-a4b473010614 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:02.963437 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0275dcf3-84c6-40c7-b521-a4b473010614 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:02.963902 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0275dcf3-84c6-40c7-b521-a4b473010614 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:02.964669 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0275dcf3-84c6-40c7-b521-a4b473010614 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:02.965108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0275dcf3-84c6-40c7-b521-a4b473010614 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:03.045192 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0275dcf3-84c6-40c7-b521-a4b473010614 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092978 Jun 21 16:54:03.045820 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 275/571] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 16:54:02 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:54:03.821319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-54090e59-4101-4f1d-af66-3a43f2ebf060 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:03.822435 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-54090e59-4101-4f1d-af66-3a43f2ebf060 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:03.828995 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-54090e59-4101-4f1d-af66-3a43f2ebf060 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:03.830013 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-54090e59-4101-4f1d-af66-3a43f2ebf060 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:03.830856 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-54090e59-4101-4f1d-af66-3a43f2ebf060 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:03.831308 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-54090e59-4101-4f1d-af66-3a43f2ebf060 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:03.861440 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-54090e59-4101-4f1d-af66-3a43f2ebf060 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043860 Jun 21 16:54:03.862009 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 297/572] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:54:03 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:54:03.934611 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-631ad5e9-7a37-4ccf-ba9a-a1c4c1552229 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:03.935197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-631ad5e9-7a37-4ccf-ba9a-a1c4c1552229 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:03.942075 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-631ad5e9-7a37-4ccf-ba9a-a1c4c1552229 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:03.942526 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-631ad5e9-7a37-4ccf-ba9a-a1c4c1552229 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:03.943296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-631ad5e9-7a37-4ccf-ba9a-a1c4c1552229 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:03.943733 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-631ad5e9-7a37-4ccf-ba9a-a1c4c1552229 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:03.969320 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-631ad5e9-7a37-4ccf-ba9a-a1c4c1552229 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:54:04.243233 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-631ad5e9-7a37-4ccf-ba9a-a1c4c1552229 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 204 len: 0 microversion: 2.1 time: 0.312416 Jun 21 16:54:04.243927 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 276/573] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:54:03 2022] DELETE /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:54:04.252545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6e7a5d21-a681-447b-b081-f92a3d7c7fac tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:04.253266 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6e7a5d21-a681-447b-b081-f92a3d7c7fac tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:04.267474 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e7a5d21-a681-447b-b081-f92a3d7c7fac tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:04.268222 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e7a5d21-a681-447b-b081-f92a3d7c7fac tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:04.275733 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e7a5d21-a681-447b-b081-f92a3d7c7fac tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:04.275733 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6e7a5d21-a681-447b-b081-f92a3d7c7fac tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:04.312375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-0b4219da-f2ac-4de1-8d8d-6a3c13c2113c req-43658889-39a5-430a-b8f0-b25817e1f9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ae4eba-c5bd-4271-8d4b-231ffc992e4d", "tag": "be3f7f6a-58a7-460b-adf0-85a4608bba76"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:04.320993 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-0b4219da-f2ac-4de1-8d8d-6a3c13c2113c req-43658889-39a5-430a-b8f0-b25817e1f9b3 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:04.321473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-0b4219da-f2ac-4de1-8d8d-6a3c13c2113c req-43658889-39a5-430a-b8f0-b25817e1f9b3 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:04.333835 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-0b4219da-f2ac-4de1-8d8d-6a3c13c2113c req-43658889-39a5-430a-b8f0-b25817e1f9b3 service nova] Creating event network-changed:be3f7f6a-58a7-460b-adf0-85a4608bba76 for instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d on hv-cinder-79987 Jun 21 16:54:04.339775 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-0b4219da-f2ac-4de1-8d8d-6a3c13c2113c req-43658889-39a5-430a-b8f0-b25817e1f9b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031285 Jun 21 16:54:04.340371 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 277/574] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:54:04.408502 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6e7a5d21-a681-447b-b081-f92a3d7c7fac tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:04.416274 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6e7a5d21-a681-447b-b081-f92a3d7c7fac tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1691 microversion: 2.1 time: 0.167706 Jun 21 16:54:04.416928 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 298/575] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:04 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:05.434560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-45a37e53-a361-4c7b-bee6-b20fcb15bdbd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:05.435311 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-45a37e53-a361-4c7b-bee6-b20fcb15bdbd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:05.441604 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-45a37e53-a361-4c7b-bee6-b20fcb15bdbd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:05.442071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-45a37e53-a361-4c7b-bee6-b20fcb15bdbd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:05.442815 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-45a37e53-a361-4c7b-bee6-b20fcb15bdbd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:05.443254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-45a37e53-a361-4c7b-bee6-b20fcb15bdbd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:05.447322 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:05.586400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-45a37e53-a361-4c7b-bee6-b20fcb15bdbd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:05.595288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-45a37e53-a361-4c7b-bee6-b20fcb15bdbd tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1691 microversion: 2.1 time: 0.165571 Jun 21 16:54:05.595954 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 278/576] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:05 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:06.612863 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b994d4f1-f01a-4624-94b7-b8b01b115568 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:06.613489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b994d4f1-f01a-4624-94b7-b8b01b115568 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:06.620501 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b994d4f1-f01a-4624-94b7-b8b01b115568 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:06.620937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b994d4f1-f01a-4624-94b7-b8b01b115568 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:06.621725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b994d4f1-f01a-4624-94b7-b8b01b115568 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:06.622154 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b994d4f1-f01a-4624-94b7-b8b01b115568 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:06.755789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b994d4f1-f01a-4624-94b7-b8b01b115568 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:06.763758 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b994d4f1-f01a-4624-94b7-b8b01b115568 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1691 microversion: 2.1 time: 0.154736 Jun 21 16:54:06.764318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 299/577] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:06 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:07.780125 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f175dfb9-8f73-4081-ac65-4404605abf92 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:07.783185 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f175dfb9-8f73-4081-ac65-4404605abf92 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:07.787709 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f175dfb9-8f73-4081-ac65-4404605abf92 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:07.788155 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f175dfb9-8f73-4081-ac65-4404605abf92 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:07.788905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f175dfb9-8f73-4081-ac65-4404605abf92 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:07.789406 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f175dfb9-8f73-4081-ac65-4404605abf92 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:07.981612 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f175dfb9-8f73-4081-ac65-4404605abf92 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:07.989063 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f175dfb9-8f73-4081-ac65-4404605abf92 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1691 microversion: 2.1 time: 0.212876 Jun 21 16:54:07.989699 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 279/578] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:07 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1691 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:09.006812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2fe2f939-6cd2-42d3-8173-86930cea2885 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:09.007574 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2fe2f939-6cd2-42d3-8173-86930cea2885 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:09.014977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2fe2f939-6cd2-42d3-8173-86930cea2885 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:09.015422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2fe2f939-6cd2-42d3-8173-86930cea2885 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:09.016320 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2fe2f939-6cd2-42d3-8173-86930cea2885 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:09.016746 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2fe2f939-6cd2-42d3-8173-86930cea2885 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:09.088847 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2fe2f939-6cd2-42d3-8173-86930cea2885 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:09.097782 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2fe2f939-6cd2-42d3-8173-86930cea2885 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1623 microversion: 2.1 time: 0.094775 Jun 21 16:54:09.098786 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 300/579] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:09 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1623 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:09.323057 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-1e1acba1-bcd4-4e70-a580-3653fbc12f59 req-c31634c0-e2d3-4b9e-82e4-05b7b38b9431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd85d90-a058-4a02-b0c5-acde031fa94f", "name": "network-vif-deleted", "tag": "205be5db-3ab1-4914-b8b3-31b16386f2c6"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:09.332617 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-1e1acba1-bcd4-4e70-a580-3653fbc12f59 req-c31634c0-e2d3-4b9e-82e4-05b7b38b9431 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:09.333348 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-1e1acba1-bcd4-4e70-a580-3653fbc12f59 req-c31634c0-e2d3-4b9e-82e4-05b7b38b9431 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:09.346511 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-1e1acba1-bcd4-4e70-a580-3653fbc12f59 req-c31634c0-e2d3-4b9e-82e4-05b7b38b9431 service nova] Creating event network-vif-deleted:205be5db-3ab1-4914-b8b3-31b16386f2c6 for instance 7bd85d90-a058-4a02-b0c5-acde031fa94f on hv-cinder-79987 Jun 21 16:54:09.353070 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-1e1acba1-bcd4-4e70-a580-3653fbc12f59 req-c31634c0-e2d3-4b9e-82e4-05b7b38b9431 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108462 Jun 21 16:54:09.359113 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 280/580] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:54:10.115129 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:10.115727 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:10.123168 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:10.127384 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:10.128185 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:10.128614 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:10.162366 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:10.162817 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:10.163273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lazy-loading 'fault' on Instance uuid 7bd85d90-a058-4a02-b0c5-acde031fa94f {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:54:10.220145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:10.227870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-542f449b-b124-4c60-981f-278eb36a10c2 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 200 len: 1335 microversion: 2.1 time: 0.116814 Jun 21 16:54:10.230552 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 301/581] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:10 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 1335 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:10.830902 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3b4d2998-57fe-476f-99e4-69eeab540975 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:10.831486 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3b4d2998-57fe-476f-99e4-69eeab540975 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:10.837655 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3b4d2998-57fe-476f-99e4-69eeab540975 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:10.838366 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3b4d2998-57fe-476f-99e4-69eeab540975 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:10.839132 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3b4d2998-57fe-476f-99e4-69eeab540975 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:10.839568 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3b4d2998-57fe-476f-99e4-69eeab540975 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:10.862101 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3b4d2998-57fe-476f-99e4-69eeab540975 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/ips" status: 200 len: 152 microversion: 2.20 time: 0.086421 Jun 21 16:54:10.862684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 281/582] 10.222.0.70 () {60 vars in 1288 bytes} [Tue Jun 21 16:54:10 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/ips => generated 152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:54:11.250827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:11.251468 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: 7bd85d90-a058-4a02-b0c5-acde031fa94f] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:11.258297 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:11.258753 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:11.259529 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:11.259966 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:11.273731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] HTTP exception thrown: Instance 7bd85d90-a058-4a02-b0c5-acde031fa94f could not be found. Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Request method failure captured: Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f HTTP/1.1 Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZn0mLuiXkothFA1iTZfSS5-_yLF0j6HitWawZCjgPGkA4OJxaSwSMT8mhFcZQGSPNw6xFR5WXxVCDVyimcJcr7TMO8KVpEXQe3RxCCLfR3ByFHqAWxQqI7UdhzT5l5J03QmKYOc-Sc6N3m_t-ei_BPoa2fHkg0tYS-JvarrnosSjI Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:54:11.276205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_25beca9acf4f4420b1a2dc0ec397847e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: f45384380b364e60823101515b359ba6 Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 7bd85d90-a058-4a02-b0c5-acde031fa94f could not be found. Jun 21 16:54:11.277944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '7bd85d90-a058-4a02-b0c5-acde031fa94f'} Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd85d90-a058-4a02-b0c5-acde031fa94f could not be found. Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:54:11.278810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd85d90-a058-4a02-b0c5-acde031fa94f could not be found. Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd85d90-a058-4a02-b0c5-acde031fa94f could not be found. Jun 21 16:54:11.280354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:54:11.281848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Returning 404 to user: Instance 7bd85d90-a058-4a02-b0c5-acde031fa94f could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:54:11.281848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-988cac1f-fa3a-4e46-a265-11ac6198a86a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f" status: 404 len: 111 microversion: 2.1 time: 0.030806 Jun 21 16:54:11.281848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 302/583] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:11 2022] GET /compute/v2.1/servers/7bd85d90-a058-4a02-b0c5-acde031fa94f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:54:11.286385 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-17eb7ddf-4caf-41ea-98ab-e10aa6bbc997 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '.version_select at 0x7f0a42abef70>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:11.371903 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-17eb7ddf-4caf-41ea-98ab-e10aa6bbc997 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912144253" status: 202 len: 0 microversion: 2.1 time: 0.088809 Jun 21 16:54:11.372318 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 282/584] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jun 21 16:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912144253 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 16:54:13.122473 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-34f3f2f1-0922-49ed-93ab-9c0a9b54ab14 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:13.123052 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-34f3f2f1-0922-49ed-93ab-9c0a9b54ab14 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:13.125846 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:13.130900 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34f3f2f1-0922-49ed-93ab-9c0a9b54ab14 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:13.131344 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34f3f2f1-0922-49ed-93ab-9c0a9b54ab14 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:13.132140 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34f3f2f1-0922-49ed-93ab-9c0a9b54ab14 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:13.132596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34f3f2f1-0922-49ed-93ab-9c0a9b54ab14 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:13.137606 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:13.157222 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-34f3f2f1-0922-49ed-93ab-9c0a9b54ab14 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lazy-loading 'flavor' on Instance uuid 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:54:13.774585 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-34f3f2f1-0922-49ed-93ab-9c0a9b54ab14 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/action" status: 202 len: 0 microversion: 2.20 time: 0.657224 Jun 21 16:54:13.775430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 303/585] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jun 21 16:54:13 2022] POST /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:54:13.784163 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:13.784885 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:13.786896 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:13.791760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:13.796988 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:13.796988 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:13.796988 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:13.926871 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:13.935536 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:13.937045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:13.938341 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-03ef5521-5d21-41e5-8b74-f1117b4a99b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.158742 Jun 21 16:54:13.938901 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 283/586] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:13 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:14.794158 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-19834016-746e-4a26-9d66-b4369d29b12a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:14.794737 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-19834016-746e-4a26-9d66-b4369d29b12a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:14.800964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-19834016-746e-4a26-9d66-b4369d29b12a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:14.801451 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-19834016-746e-4a26-9d66-b4369d29b12a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:14.802241 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-19834016-746e-4a26-9d66-b4369d29b12a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:14.802675 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-19834016-746e-4a26-9d66-b4369d29b12a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:14.827883 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-19834016-746e-4a26-9d66-b4369d29b12a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Going to try to terminate instance {{(pid=124685) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:54:14.957528 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:14.958135 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:14.966034 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:14.966508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:14.967311 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:14.967746 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:15.081057 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-19834016-746e-4a26-9d66-b4369d29b12a tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 204 len: 0 microversion: 2.1 time: 0.291348 Jun 21 16:54:15.081943 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 304/587] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:54:14 2022] DELETE /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:54:15.091529 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5e06350e-b771-4808-866d-776ca1476dab tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:15.092260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5e06350e-b771-4808-866d-776ca1476dab tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:15.098695 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5e06350e-b771-4808-866d-776ca1476dab tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:15.099001 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5e06350e-b771-4808-866d-776ca1476dab tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:15.099755 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5e06350e-b771-4808-866d-776ca1476dab tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:15.100250 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5e06350e-b771-4808-866d-776ca1476dab tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:15.101147 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:15.109612 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:15.111121 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:15.112283 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6731801f-1446-468d-8a6f-c4a0f6d8d068 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.158842 Jun 21 16:54:15.112915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 284/588] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:14 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:54:15.235337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-5e06350e-b771-4808-866d-776ca1476dab tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:15.242702 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5e06350e-b771-4808-866d-776ca1476dab tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1508 microversion: 2.1 time: 0.155932 Jun 21 16:54:15.243253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 305/589] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:15 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:16.132100 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:16.132700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:16.139381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:16.139827 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:16.140589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:16.141032 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:16.261456 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e7a98fd5-7cb7-44d3-9889-9f98693c520d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:16.262671 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e7a98fd5-7cb7-44d3-9889-9f98693c520d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:16.272756 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7a98fd5-7cb7-44d3-9889-9f98693c520d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:16.273204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7a98fd5-7cb7-44d3-9889-9f98693c520d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:16.273999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7a98fd5-7cb7-44d3-9889-9f98693c520d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:16.274429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e7a98fd5-7cb7-44d3-9889-9f98693c520d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:16.277956 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:16.286178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:16.287709 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:16.288900 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4ab4e6ed-6e9f-4ed6-ac3f-d558ea23f66b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.160769 Jun 21 16:54:16.289480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 285/590] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:16 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:16.406612 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e7a98fd5-7cb7-44d3-9889-9f98693c520d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:16.414021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e7a98fd5-7cb7-44d3-9889-9f98693c520d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1508 microversion: 2.1 time: 0.157065 Jun 21 16:54:16.414583 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 306/591] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:16 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:17.308003 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:17.308610 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:17.315811 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:17.316252 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:17.317016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:17.317481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:17.431733 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-866174b4-b875-4ad8-b199-7248b78cabec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:17.432252 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-866174b4-b875-4ad8-b199-7248b78cabec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:17.439413 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-866174b4-b875-4ad8-b199-7248b78cabec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:17.439855 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-866174b4-b875-4ad8-b199-7248b78cabec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:17.440610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-866174b4-b875-4ad8-b199-7248b78cabec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:17.441038 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-866174b4-b875-4ad8-b199-7248b78cabec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:17.511566 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:17.520153 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:17.521956 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:17.523269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8096cff2-6dc4-4c0b-9619-ff7459bad128 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.219153 Jun 21 16:54:17.523940 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 286/592] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:17 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:17.579895 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-866174b4-b875-4ad8-b199-7248b78cabec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:17.587338 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-866174b4-b875-4ad8-b199-7248b78cabec tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1508 microversion: 2.1 time: 0.159571 Jun 21 16:54:17.587894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 307/593] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:17 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:17.734278 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-09176020-d781-4c6e-b850-d42af271b4a1 req-b1a4faff-45ae-4851-9734-c48e548103d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3358207-e4db-4c88-b56b-05f718c39a8e", "name": "network-vif-deleted", "tag": "1382e7bf-7f7f-4cf3-a568-1e6303eb5b15"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:17.742456 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-09176020-d781-4c6e-b850-d42af271b4a1 req-b1a4faff-45ae-4851-9734-c48e548103d4 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:17.742886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-09176020-d781-4c6e-b850-d42af271b4a1 req-b1a4faff-45ae-4851-9734-c48e548103d4 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:17.755209 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-09176020-d781-4c6e-b850-d42af271b4a1 req-b1a4faff-45ae-4851-9734-c48e548103d4 service nova] Creating event network-vif-deleted:1382e7bf-7f7f-4cf3-a568-1e6303eb5b15 for instance f3358207-e4db-4c88-b56b-05f718c39a8e on hv-cinder-79987 Jun 21 16:54:17.760467 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-09176020-d781-4c6e-b850-d42af271b4a1 req-b1a4faff-45ae-4851-9734-c48e548103d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030303 Jun 21 16:54:17.761090 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 287/594] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:54:18.542902 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:18.543668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:18.550146 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:18.550606 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:18.551353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:18.551782 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:18.605111 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:18.605874 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:18.612768 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:18.613215 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:18.614398 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:18.614893 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:18.649586 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:18.650039 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:18.650493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lazy-loading 'fault' on Instance uuid f3358207-e4db-4c88-b56b-05f718c39a8e {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:54:18.686808 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:18.693690 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:18.694906 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:18.696455 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:18.697620 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7fcca075-da99-48b1-b3ac-ff4be21c9d33 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.158670 Jun 21 16:54:18.698171 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 308/595] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:18 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:18.701917 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cbf30b84-71c2-468c-9a88-f30b833aa717 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 200 len: 1312 microversion: 2.1 time: 0.101629 Jun 21 16:54:18.702470 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 288/596] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:18 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:19.716353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:19.717676 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:19.719606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:19.720257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: f3358207-e4db-4c88-b56b-05f718c39a8e] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:19.724356 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:19.724809 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:19.725733 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:19.726175 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:19.726681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:19.727211 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:19.727959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:19.728391 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:19.742666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] HTTP exception thrown: Instance f3358207-e4db-4c88-b56b-05f718c39a8e could not be found. Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Request method failure captured: Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e HTTP/1.1 Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZn0mLuiXkothFA1iTZfSS5-_yLF0j6HitWawZCjgPGkA4OJxaSwSMT8mhFcZQGSPNw6xFR5WXxVCDVyimcJcr7TMO8KVpEXQe3RxCCLfR3ByFHqAWxQqI7UdhzT5l5J03QmKYOc-Sc6N3m_t-ei_BPoa2fHkg0tYS-JvarrnosSjI Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:54:19.744340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_25beca9acf4f4420b1a2dc0ec397847e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: f45384380b364e60823101515b359ba6 Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance f3358207-e4db-4c88-b56b-05f718c39a8e could not be found. Jun 21 16:54:19.745809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': 'f3358207-e4db-4c88-b56b-05f718c39a8e'} Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3358207-e4db-4c88-b56b-05f718c39a8e could not be found. Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:54:19.746760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3358207-e4db-4c88-b56b-05f718c39a8e could not be found. Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3358207-e4db-4c88-b56b-05f718c39a8e could not be found. Jun 21 16:54:19.748236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:19.750003 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Returning 404 to user: Instance f3358207-e4db-4c88-b56b-05f718c39a8e could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:54:19.750003 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-51617497-bbe7-4800-903c-d4358459f31e tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e" status: 404 len: 111 microversion: 2.1 time: 0.030862 Jun 21 16:54:19.750003 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 289/597] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:19 2022] GET /compute/v2.1/servers/f3358207-e4db-4c88-b56b-05f718c39a8e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 16:54:19.754343 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-484347f3-f1be-43a1-b0cb-816ec867ea1c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:19.754822 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-484347f3-f1be-43a1-b0cb-816ec867ea1c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:19.760604 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-484347f3-f1be-43a1-b0cb-816ec867ea1c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:19.761047 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-484347f3-f1be-43a1-b0cb-816ec867ea1c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:19.761824 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-484347f3-f1be-43a1-b0cb-816ec867ea1c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:19.762247 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-484347f3-f1be-43a1-b0cb-816ec867ea1c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:19.789343 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-484347f3-f1be-43a1-b0cb-816ec867ea1c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:54:19.856802 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:19.865593 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:19.867087 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:19.868313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b746d6da-7f9a-4165-9f9b-ce691aae7783 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.155805 Jun 21 16:54:19.868861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 309/598] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:19 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:20.146654 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-484347f3-f1be-43a1-b0cb-816ec867ea1c tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 204 len: 0 microversion: 2.1 time: 0.395543 Jun 21 16:54:20.147238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 290/599] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:54:19 2022] DELETE /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:54:20.155970 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4c763585-ac90-46ab-85f3-fdd9cfd96c87 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:20.156568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4c763585-ac90-46ab-85f3-fdd9cfd96c87 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:20.162739 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4c763585-ac90-46ab-85f3-fdd9cfd96c87 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:20.163181 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4c763585-ac90-46ab-85f3-fdd9cfd96c87 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:20.163941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4c763585-ac90-46ab-85f3-fdd9cfd96c87 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:20.164373 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4c763585-ac90-46ab-85f3-fdd9cfd96c87 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:20.298770 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4c763585-ac90-46ab-85f3-fdd9cfd96c87 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:20.305023 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4c763585-ac90-46ab-85f3-fdd9cfd96c87 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.153734 Jun 21 16:54:20.305613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 310/600] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:20 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:20.887514 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:20.888199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:20.895146 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:20.895586 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:20.896339 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:20.896759 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:21.029622 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:21.038010 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:21.039545 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:21.040688 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f8c8ba4d-b34c-4c87-82ff-e67b4f4a0c9b tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.157434 Jun 21 16:54:21.041236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 291/601] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:20 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:21.327541 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-03bc8f4e-f17e-4037-8c9c-0d81bb78e4f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:21.328165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-03bc8f4e-f17e-4037-8c9c-0d81bb78e4f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:21.335246 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-03bc8f4e-f17e-4037-8c9c-0d81bb78e4f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:21.335692 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-03bc8f4e-f17e-4037-8c9c-0d81bb78e4f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:21.336460 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-03bc8f4e-f17e-4037-8c9c-0d81bb78e4f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:21.336893 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-03bc8f4e-f17e-4037-8c9c-0d81bb78e4f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:21.471827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-03bc8f4e-f17e-4037-8c9c-0d81bb78e4f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:21.479139 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-03bc8f4e-f17e-4037-8c9c-0d81bb78e4f3 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.155662 Jun 21 16:54:21.479695 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 311/602] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:21 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:22.059345 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:22.059923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:22.066942 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:22.067384 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:22.068131 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:22.068558 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:22.197378 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:22.205857 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:22.207358 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:22.208480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5993c139-5daf-42f7-8442-8139cd7a9011 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.153222 Jun 21 16:54:22.209033 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 292/603] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:22 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:54:22.495930 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7119e37d-7f73-4d7b-8928-f3b7a64a02f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:22.496453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7119e37d-7f73-4d7b-8928-f3b7a64a02f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:22.503886 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7119e37d-7f73-4d7b-8928-f3b7a64a02f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:22.504611 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7119e37d-7f73-4d7b-8928-f3b7a64a02f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:22.505404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7119e37d-7f73-4d7b-8928-f3b7a64a02f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:22.505839 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7119e37d-7f73-4d7b-8928-f3b7a64a02f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:22.640934 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7119e37d-7f73-4d7b-8928-f3b7a64a02f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:22.648543 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7119e37d-7f73-4d7b-8928-f3b7a64a02f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1523 microversion: 2.1 time: 0.156554 Jun 21 16:54:22.649102 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 312/604] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:22 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:23.226879 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:23.227438 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:23.234543 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:23.234990 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:23.235795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:23.236225 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:23.453625 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:23.461633 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:23.463159 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:23.464305 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-19b99756-89a9-4482-9aa7-f1a5e8e54c3c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.241421 Jun 21 16:54:23.464866 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 293/605] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:23 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:23.666119 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-aef78ac0-3ce5-4bf6-b32d-8757f15d14f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:23.666729 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-aef78ac0-3ce5-4bf6-b32d-8757f15d14f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:23.673486 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aef78ac0-3ce5-4bf6-b32d-8757f15d14f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:23.673934 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aef78ac0-3ce5-4bf6-b32d-8757f15d14f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:23.674695 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aef78ac0-3ce5-4bf6-b32d-8757f15d14f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:23.675127 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aef78ac0-3ce5-4bf6-b32d-8757f15d14f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:23.741008 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-aef78ac0-3ce5-4bf6-b32d-8757f15d14f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:23.746126 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-88800bc9-f9ec-4bbd-b921-7919df5a4ad1 req-1c0bff50-7bdb-4c92-bbb1-b560f5326c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12e3b57-72af-4292-ba65-d90c166a49ed", "name": "network-vif-deleted", "tag": "4c3527eb-ca57-4f3c-ac3f-f1b1d9060481"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:23.750814 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-aef78ac0-3ce5-4bf6-b32d-8757f15d14f0 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1481 microversion: 2.1 time: 0.088267 Jun 21 16:54:23.751111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 313/606] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:23 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1481 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:23.757401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-88800bc9-f9ec-4bbd-b921-7919df5a4ad1 req-1c0bff50-7bdb-4c92-bbb1-b560f5326c46 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:23.757846 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-88800bc9-f9ec-4bbd-b921-7919df5a4ad1 req-1c0bff50-7bdb-4c92-bbb1-b560f5326c46 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:23.768662 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-88800bc9-f9ec-4bbd-b921-7919df5a4ad1 req-1c0bff50-7bdb-4c92-bbb1-b560f5326c46 service nova] Creating event network-vif-deleted:4c3527eb-ca57-4f3c-ac3f-f1b1d9060481 for instance b12e3b57-72af-4292-ba65-d90c166a49ed on hv-cinder-79987 Jun 21 16:54:23.773505 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-88800bc9-f9ec-4bbd-b921-7919df5a4ad1 req-1c0bff50-7bdb-4c92-bbb1-b560f5326c46 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Jun 21 16:54:23.775495 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 294/607] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:54:24.482377 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:24.483151 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:24.489131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:24.489612 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:24.490425 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:24.490857 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:24.624117 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:24.632355 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:24.633869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:24.639208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-86736238-c6d2-4c14-9e50-8241e8670b81 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.156837 Jun 21 16:54:24.639208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 314/608] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:24 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:24.769768 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:24.770475 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:24.782214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:24.782214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:24.782214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:24.782214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:24.814032 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:24.814509 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:24.814960 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lazy-loading 'fault' on Instance uuid b12e3b57-72af-4292-ba65-d90c166a49ed {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:54:24.861561 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45384380b364e60823101515b359ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25beca9acf4f4420b1a2dc0ec397847e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:24.868807 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e187de42-22fa-4ad5-a6e3-2186003a4d0d tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 200 len: 1312 microversion: 2.1 time: 0.105075 Jun 21 16:54:24.869499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 295/609] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:24 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:25.654797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:25.655490 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:25.662234 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:25.662678 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:25.663439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:25.663871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:25.795520 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:25.803839 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:25.805301 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:25.806489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-829092b2-4eb6-48e8-95a4-31be7d7c6dca tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.155836 Jun 21 16:54:25.807045 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 315/610] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:25 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:25.887956 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:25.889245 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] [instance: b12e3b57-72af-4292-ba65-d90c166a49ed] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:25.895994 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:25.896441 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:25.897204 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:25.897677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:25.910815 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] HTTP exception thrown: Instance b12e3b57-72af-4292-ba65-d90c166a49ed could not be found. Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Request method failure captured: Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed HTTP/1.1 Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZn0mLuiXkothFA1iTZfSS5-_yLF0j6HitWawZCjgPGkA4OJxaSwSMT8mhFcZQGSPNw6xFR5WXxVCDVyimcJcr7TMO8KVpEXQe3RxCCLfR3ByFHqAWxQqI7UdhzT5l5J03QmKYOc-Sc6N3m_t-ei_BPoa2fHkg0tYS-JvarrnosSjI Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:54:25.912493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/25beca9acf4f4420b1a2dc0ec397847e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_25beca9acf4f4420b1a2dc0ec397847e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 25beca9acf4f4420b1a2dc0ec397847e Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1859414168 Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: f45384380b364e60823101515b359ba6 Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1859414168-project Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance b12e3b57-72af-4292-ba65-d90c166a49ed could not be found. Jun 21 16:54:25.913974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': 'b12e3b57-72af-4292-ba65-d90c166a49ed'} Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12e3b57-72af-4292-ba65-d90c166a49ed could not be found. Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:54:25.914719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12e3b57-72af-4292-ba65-d90c166a49ed could not be found. Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12e3b57-72af-4292-ba65-d90c166a49ed could not be found. Jun 21 16:54:25.916160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:54:25.917461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] Returning 404 to user: Instance b12e3b57-72af-4292-ba65-d90c166a49ed could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:54:25.917461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-861dba3f-7c67-48bb-a453-a0022f73b0a4 tempest-ServerRescueNegativeTestJSON-1859414168 tempest-ServerRescueNegativeTestJSON-1859414168-project] 10.222.0.70 "GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed" status: 404 len: 111 microversion: 2.1 time: 0.029921 Jun 21 16:54:25.917461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 296/611] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:25 2022] GET /compute/v2.1/servers/b12e3b57-72af-4292-ba65-d90c166a49ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:54:26.825428 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:26.826590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:26.833123 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:26.833616 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:26.834387 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:26.834820 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:26.838905 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:26.968603 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:26.976654 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:26.978199 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:26.979778 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f7712b76-1e63-42e5-a79a-10f3322b27f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.158406 Jun 21 16:54:26.980330 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 316/612] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:26 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:27.999672 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:28.001573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:28.008251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:28.008767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:28.009815 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:28.010320 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:28.015611 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:28.223376 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:28.231567 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:28.233778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:28.234991 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1ff5ca44-26d5-4218-b2ff-a4322141648d tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.240353 Jun 21 16:54:28.235556 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 297/613] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:27 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:29.257189 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:29.258086 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:29.273926 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:29.274383 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:29.275172 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:29.275704 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:29.528250 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:29.537246 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:29.539148 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:29.540329 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-55d3be12-2dce-4370-9c4e-9f67cb59b774 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.288857 Jun 21 16:54:29.540876 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 317/614] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:29 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:54:30.560126 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:30.560782 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:30.567458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:30.567913 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:30.568675 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:30.569111 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:30.726790 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:30.736088 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:30.738250 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:30.739445 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-80c4e902-4cb3-4ffe-a61a-0fca41e4d0b3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1745 microversion: 2.20 time: 0.183923 Jun 21 16:54:30.740226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 298/615] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:30 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:31.759643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:31.760290 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:31.767357 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:31.768393 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:31.771156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:31.771156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:31.924221 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-f8ccc479-4a70-4b6d-bede-3c7d78de6444 req-b28264f2-6662-4479-84bb-f34e455be63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a46d00d-8f66-43bf-990b-e31ab81b9ae0", "name": "network-vif-plugged", "status": "completed", "tag": "9422fb6f-a2be-40f8-9c46-eb984da56a96"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:31.933270 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-f8ccc479-4a70-4b6d-bede-3c7d78de6444 req-b28264f2-6662-4479-84bb-f34e455be63a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:31.934077 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-f8ccc479-4a70-4b6d-bede-3c7d78de6444 req-b28264f2-6662-4479-84bb-f34e455be63a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:31.946366 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-f8ccc479-4a70-4b6d-bede-3c7d78de6444 req-b28264f2-6662-4479-84bb-f34e455be63a service nova] Creating event network-vif-plugged:9422fb6f-a2be-40f8-9c46-eb984da56a96 for instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 on hv-cinder-79987 Jun 21 16:54:31.952259 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-f8ccc479-4a70-4b6d-bede-3c7d78de6444 req-b28264f2-6662-4479-84bb-f34e455be63a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176755 Jun 21 16:54:31.953497 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 299/616] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:54:31.999681 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:32.008008 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:32.009553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:32.010711 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-248c5cc7-6af0-4c56-8f7f-27b8f30dd7d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.254964 Jun 21 16:54:32.011273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 318/617] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:31 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:33.032241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:33.033665 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:33.040436 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:33.040886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:33.041716 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:33.042367 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:33.255014 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:33.265734 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:33.268058 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:33.269534 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9197dd2c-85bc-48dc-aa57-cfae18f3c46e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.244283 Jun 21 16:54:33.271627 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 300/618] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:33 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:34.290621 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:34.291225 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:34.310515 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:34.310961 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:34.314731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:34.315429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:34.676108 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:34.689612 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:34.692116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:34.693990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6d1b7a80-546b-44d3-9846-10a5ec8bf8d1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.408891 Jun 21 16:54:34.713036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 319/619] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:34 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:35.711820 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:35.712415 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:35.721319 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:35.726826 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:35.728079 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:35.730821 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:35.988591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:36.002240 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:36.004229 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:36.010197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cdd920f4-591f-4263-8911-5c2b81f35758 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.302047 Jun 21 16:54:36.012802 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 301/620] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:35 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:37.031441 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:37.032678 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:37.051888 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:37.052676 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:37.057742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:37.058610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:37.303111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:37.312290 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:37.314129 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:37.315604 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-59cdcd7b-ae58-4c4e-ba60-7254390ec4aa tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.289190 Jun 21 16:54:37.316425 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 320/621] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:37 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:38.335333 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:38.335943 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:38.344566 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:38.345022 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:38.345860 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:38.346293 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:38.625558 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:38.638804 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:38.646657 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:38.648322 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b88ab4e4-a021-448d-96ab-183cd63bd30c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.317857 Jun 21 16:54:38.650151 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 302/622] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:38 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:39.275991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-cd3d8b32-1bdd-408a-964b-bb4ac935392b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: .version_select at 0x7f0a42aad940>, body: {"keypair": {"name": "tempest-keypair-1576838783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4cB7ePfBmhR3mtkVmjHX40jInP512R2wEc0dm23d2l5HQBIr2L2Z2tGIw22pZ9bwzXSM51hHgrps7YoeZTPEl8/7uFkg0/EVoP2XLdkRpv0Poj9RkSSWLbxDOuaqnucQ=="}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:39.293755 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-cd3d8b32-1bdd-408a-964b-bb4ac935392b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'key_pairs'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:54:39.299531 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-cd3d8b32-1bdd-408a-964b-bb4ac935392b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for user 8d1c7f32f0624210ae0ba52c022fea5a and project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'key_pairs'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:54:39.563590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-cd3d8b32-1bdd-408a-964b-bb4ac935392b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.355520 Jun 21 16:54:39.564204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 321/623] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 16:54:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:54:39.667525 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:39.668135 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:39.675357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:39.676944 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:39.678734 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:39.679396 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:39.854002 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:39.863776 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:39.866868 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:39.869553 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8fb329ef-f32a-4267-9a0e-496fb2bdec20 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.204867 Jun 21 16:54:39.870990 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 303/624] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:39 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:40.888120 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:40.888730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:40.900632 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:40.901707 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:40.903277 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:40.903975 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:41.109192 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:41.118295 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:41.123007 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:41.124276 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2064b07b-c97f-44d0-b5bf-67eb45e9b851 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.240066 Jun 21 16:54:41.130082 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 322/625] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:40 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:42.148749 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:42.149531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:42.162982 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:42.163554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:42.164461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:42.164948 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:42.430803 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:42.441404 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:42.443386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:42.444881 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c2f2317c-e619-4670-aef7-aab173b8e07c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.300908 Jun 21 16:54:42.446136 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 304/626] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:42 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:42.610148 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1402563626", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83741c3b-7ff0-4b33-b398-e82b72fea3bd"}], "security_groups": [{"name": "tempest-securitygroup--1979903640"}], "key_name": "tempest-keypair-1576838783", "user_data": "}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:42.749469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] validate_networks() for [('83741c3b-7ff0-4b33-b398-e82b72fea3bd', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:54:43.291055 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:54:43.291601 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:54:43.292161 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:54:43.292750 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:54:43.293347 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:54:43.304454 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:43.305045 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:43.306562 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:43.307405 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:43.328214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:54:43.332421 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for user 8d1c7f32f0624210ae0ba52c022fea5a and project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:54:43.344431 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:54:43.346781 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:54:43.464517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:43.465238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:43.472936 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:43.473419 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:43.474168 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:43.474593 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:43.595419 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d36722be-10a9-4dd7-8a90-e200e4c7e16e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.990189 Jun 21 16:54:43.596085 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 323/627] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:54:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:54:43.608905 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ad1ff747-386f-4483-ab7a-7e7f7ee292d2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:43.609556 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ad1ff747-386f-4483-ab7a-7e7f7ee292d2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:43.611471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:43.629148 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:43.645575 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:43.655694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:43.660558 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5a8c6637-ff89-429f-9bc5-b2b48c9f4123 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.200269 Jun 21 16:54:43.662290 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 305/628] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:43 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:54:43.691493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ad1ff747-386f-4483-ab7a-7e7f7ee292d2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:43.698881 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ad1ff747-386f-4483-ab7a-7e7f7ee292d2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1242 microversion: 2.1 time: 0.094471 Jun 21 16:54:43.699809 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 324/629] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:43 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:44.679308 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:44.679877 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:44.686710 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:44.687158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:44.687917 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:44.688350 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:44.716233 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e404744f-0cba-407e-ab3e-2a5a2f20aa32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:44.716829 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e404744f-0cba-407e-ab3e-2a5a2f20aa32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:44.795018 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e404744f-0cba-407e-ab3e-2a5a2f20aa32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:44.803099 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e404744f-0cba-407e-ab3e-2a5a2f20aa32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1242 microversion: 2.1 time: 0.090755 Jun 21 16:54:44.803805 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 325/630] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:44 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:44.836107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:44.844803 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:44.846778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:44.847480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a70fcccd-3391-4b72-be95-6519fd0cf7df tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1740 microversion: 2.20 time: 0.172351 Jun 21 16:54:44.848055 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 306/631] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:44 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:45.820404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9470e301-d23c-445e-bd92-1ae94cc5121e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:45.820945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9470e301-d23c-445e-bd92-1ae94cc5121e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:45.828553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9470e301-d23c-445e-bd92-1ae94cc5121e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:45.829010 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9470e301-d23c-445e-bd92-1ae94cc5121e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:45.829803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9470e301-d23c-445e-bd92-1ae94cc5121e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:45.830237 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9470e301-d23c-445e-bd92-1ae94cc5121e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:45.870062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:45.871261 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:45.876008 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:45.882786 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:45.883233 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:45.884004 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:45.884441 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:45.906819 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9470e301-d23c-445e-bd92-1ae94cc5121e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:45.914895 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9470e301-d23c-445e-bd92-1ae94cc5121e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1294 microversion: 2.1 time: 0.098777 Jun 21 16:54:45.915466 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 326/632] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:45 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:46.022750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:46.031320 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:46.033013 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:46.034261 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0093fe5c-8c8e-48e8-bd89-13d821fc7653 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1722 microversion: 2.20 time: 0.171560 Jun 21 16:54:46.034812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 307/633] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:45 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:54:46.933352 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2ce3b771-439d-4f43-8b30-1a161dac431f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:46.933922 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2ce3b771-439d-4f43-8b30-1a161dac431f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:46.940554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2ce3b771-439d-4f43-8b30-1a161dac431f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:46.941006 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2ce3b771-439d-4f43-8b30-1a161dac431f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:46.941800 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2ce3b771-439d-4f43-8b30-1a161dac431f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:46.942237 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2ce3b771-439d-4f43-8b30-1a161dac431f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:47.004358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2ce3b771-439d-4f43-8b30-1a161dac431f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:47.011728 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2ce3b771-439d-4f43-8b30-1a161dac431f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1302 microversion: 2.1 time: 0.082331 Jun 21 16:54:47.012295 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 327/634] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:46 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:47.052170 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:47.052780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:47.059657 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:47.060101 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:47.061015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:47.061015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:47.195474 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:47.204138 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:47.205701 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:47.206889 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2f1d7cf6-1917-41c6-ba8e-e65b8632c4a8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1722 microversion: 2.20 time: 0.158752 Jun 21 16:54:47.211634 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 308/635] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:47 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:47.833217 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-6c2ffff0-4551-49e1-8961-7b4c38521bfe req-938a2c17-0a1f-4b16-bee4-a686192c082a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a46d00d-8f66-43bf-990b-e31ab81b9ae0", "name": "network-vif-unplugged", "status": "completed", "tag": "9422fb6f-a2be-40f8-9c46-eb984da56a96"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:47.843057 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6c2ffff0-4551-49e1-8961-7b4c38521bfe req-938a2c17-0a1f-4b16-bee4-a686192c082a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:47.843931 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6c2ffff0-4551-49e1-8961-7b4c38521bfe req-938a2c17-0a1f-4b16-bee4-a686192c082a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:47.856155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-6c2ffff0-4551-49e1-8961-7b4c38521bfe req-938a2c17-0a1f-4b16-bee4-a686192c082a service nova] Creating event network-vif-unplugged:9422fb6f-a2be-40f8-9c46-eb984da56a96 for instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 on hv-cinder-79987 Jun 21 16:54:47.862071 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-6c2ffff0-4551-49e1-8961-7b4c38521bfe req-938a2c17-0a1f-4b16-bee4-a686192c082a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033496 Jun 21 16:54:47.862667 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 328/636] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:54:48.029251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f50bdbe8-90e8-4d78-b43d-92abd12f7166 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:48.029927 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f50bdbe8-90e8-4d78-b43d-92abd12f7166 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:48.037702 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5c929ef2-afd9-4163-89ae-b0a81ff12e32 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:48.038281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5c929ef2-afd9-4163-89ae-b0a81ff12e32 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:48.039595 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f50bdbe8-90e8-4d78-b43d-92abd12f7166 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:48.040041 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f50bdbe8-90e8-4d78-b43d-92abd12f7166 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:48.040803 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f50bdbe8-90e8-4d78-b43d-92abd12f7166 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:48.041226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f50bdbe8-90e8-4d78-b43d-92abd12f7166 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:48.046186 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5c929ef2-afd9-4163-89ae-b0a81ff12e32 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:48.046706 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5c929ef2-afd9-4163-89ae-b0a81ff12e32 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:48.047422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5c929ef2-afd9-4163-89ae-b0a81ff12e32 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:48.048331 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5c929ef2-afd9-4163-89ae-b0a81ff12e32 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:48.088291 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5c929ef2-afd9-4163-89ae-b0a81ff12e32 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/ips" status: 200 len: 147 microversion: 2.1 time: 0.055319 Jun 21 16:54:48.088868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 329/637] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:54:48 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/ips => generated 147 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:54:48.137003 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f50bdbe8-90e8-4d78-b43d-92abd12f7166 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:48.149014 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f50bdbe8-90e8-4d78-b43d-92abd12f7166 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1312 microversion: 2.1 time: 0.123586 Jun 21 16:54:48.149651 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 309/638] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:48 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:48.227478 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:48.229033 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:48.236621 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:48.237075 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:48.237880 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:48.238318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:48.379745 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:48.388013 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:48.389608 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:48.390773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-09265791-612b-475c-ac13-28939fdf6f80 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1725 microversion: 2.20 time: 0.169396 Jun 21 16:54:48.391327 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 330/639] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:48 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:48.409745 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-29c99ecd-0dd2-424e-9c35-420e2aed6904 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8fd234e-0f79-47a5-8dda-c5faa9612b84"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:48.410871 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-29c99ecd-0dd2-424e-9c35-420e2aed6904 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:48.416875 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-29c99ecd-0dd2-424e-9c35-420e2aed6904 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:48.421073 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-29c99ecd-0dd2-424e-9c35-420e2aed6904 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:48.421073 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-29c99ecd-0dd2-424e-9c35-420e2aed6904 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:48.421073 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-29c99ecd-0dd2-424e-9c35-420e2aed6904 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.167695 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1733fd32-50a3-4983-8c17-0f8cb228ea67 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:49.168999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1733fd32-50a3-4983-8c17-0f8cb228ea67 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:49.175970 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1733fd32-50a3-4983-8c17-0f8cb228ea67 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.176413 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1733fd32-50a3-4983-8c17-0f8cb228ea67 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.177179 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1733fd32-50a3-4983-8c17-0f8cb228ea67 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.177644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1733fd32-50a3-4983-8c17-0f8cb228ea67 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.331100 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1733fd32-50a3-4983-8c17-0f8cb228ea67 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:49.338644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1733fd32-50a3-4983-8c17-0f8cb228ea67 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.175121 Jun 21 16:54:49.339742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 331/640] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:49 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:49.345335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-71d0d78c-c501-45a3-90a3-2e535f105977 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:49.346097 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-71d0d78c-c501-45a3-90a3-2e535f105977 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:49.353111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71d0d78c-c501-45a3-90a3-2e535f105977 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.353690 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71d0d78c-c501-45a3-90a3-2e535f105977 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.354746 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71d0d78c-c501-45a3-90a3-2e535f105977 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.355799 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71d0d78c-c501-45a3-90a3-2e535f105977 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.384205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-71d0d78c-c501-45a3-90a3-2e535f105977 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lazy-loading 'flavor' on Instance uuid 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:54:49.684194 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-71d0d78c-c501-45a3-90a3-2e535f105977 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "POST /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4/action" status: 202 len: 0 microversion: 2.1 time: 0.342889 Jun 21 16:54:49.684816 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 332/641] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:54:49 2022] POST /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:54:49.692063 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-15ff75c6-dced-4fa2-93d4-e648c8fe7570 req-0ea5409c-966b-47c5-8229-27e80c30e1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c19e657-0d31-410a-b755-4e2d41c926d6", "tag": "10e929cc-6721-4663-927d-8eb4ca2d862b"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:49.700603 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-15ff75c6-dced-4fa2-93d4-e648c8fe7570 req-0ea5409c-966b-47c5-8229-27e80c30e1ac service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.701313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-15ff75c6-dced-4fa2-93d4-e648c8fe7570 req-0ea5409c-966b-47c5-8229-27e80c30e1ac service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.701600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-29c99ecd-0dd2-424e-9c35-420e2aed6904 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.296573 Jun 21 16:54:49.705050 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 310/642] 10.222.0.70 () {62 vars in 1363 bytes} [Tue Jun 21 16:54:48 2022] POST /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/os-volume_attachments => generated 188 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 16:54:49.713764 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ad76bd4d-b7a8-444e-b6b5-39aefa402d7f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:49.715269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ad76bd4d-b7a8-444e-b6b5-39aefa402d7f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:49.715714 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-15ff75c6-dced-4fa2-93d4-e648c8fe7570 req-0ea5409c-966b-47c5-8229-27e80c30e1ac service nova] Creating event network-changed:10e929cc-6721-4663-927d-8eb4ca2d862b for instance 1c19e657-0d31-410a-b755-4e2d41c926d6 on hv-cinder-79987 Jun 21 16:54:49.724955 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ad76bd4d-b7a8-444e-b6b5-39aefa402d7f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.725431 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ad76bd4d-b7a8-444e-b6b5-39aefa402d7f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.726208 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ad76bd4d-b7a8-444e-b6b5-39aefa402d7f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.726637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ad76bd4d-b7a8-444e-b6b5-39aefa402d7f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.730230 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-15ff75c6-dced-4fa2-93d4-e648c8fe7570 req-0ea5409c-966b-47c5-8229-27e80c30e1ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042038 Jun 21 16:54:49.731261 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 333/643] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:54:49.823701 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b14b00e8-33a6-4e28-ba39-b8b4a95e5297 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "900a112e-7b57-40b2-8910-afe246e6c7aa"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:49.824861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b14b00e8-33a6-4e28-ba39-b8b4a95e5297 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:49.831552 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b14b00e8-33a6-4e28-ba39-b8b4a95e5297 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.832230 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b14b00e8-33a6-4e28-ba39-b8b4a95e5297 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.833174 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b14b00e8-33a6-4e28-ba39-b8b4a95e5297 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.833659 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b14b00e8-33a6-4e28-ba39-b8b4a95e5297 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.945586 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ad76bd4d-b7a8-444e-b6b5-39aefa402d7f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:49.952461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:49.955241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ad76bd4d-b7a8-444e-b6b5-39aefa402d7f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.248866 Jun 21 16:54:49.955848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 311/644] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:49 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:49.967052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f7bf9baf-b5d6-416a-939a-3dcd66ba85b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:49.968473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f7bf9baf-b5d6-416a-939a-3dcd66ba85b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:49.975032 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f7bf9baf-b5d6-416a-939a-3dcd66ba85b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.975479 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f7bf9baf-b5d6-416a-939a-3dcd66ba85b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:49.976257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f7bf9baf-b5d6-416a-939a-3dcd66ba85b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:49.976666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f7bf9baf-b5d6-416a-939a-3dcd66ba85b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:50.637551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:50.663964 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f7bf9baf-b5d6-416a-939a-3dcd66ba85b8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/os-volume_attachments/c8fd234e-0f79-47a5-8dda-c5faa9612b84" status: 202 len: 0 microversion: 2.20 time: 0.701464 Jun 21 16:54:50.664564 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 312/645] 10.222.0.70 () {60 vars in 1456 bytes} [Tue Jun 21 16:54:49 2022] DELETE /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/os-volume_attachments/c8fd234e-0f79-47a5-8dda-c5faa9612b84 => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:54:50.691953 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0495781b-1139-4e02-bb81-18f295ab39c5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:50.691953 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0495781b-1139-4e02-bb81-18f295ab39c5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:50.691953 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0495781b-1139-4e02-bb81-18f295ab39c5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:50.691953 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0495781b-1139-4e02-bb81-18f295ab39c5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:50.692773 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0495781b-1139-4e02-bb81-18f295ab39c5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:50.692773 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0495781b-1139-4e02-bb81-18f295ab39c5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:50.746710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b14b00e8-33a6-4e28-ba39-b8b4a95e5297 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.927092 Jun 21 16:54:50.747802 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 334/646] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:54:49 2022] POST /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments => generated 194 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:54:50.755577 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3000269d-7697-4457-97d2-15eeef2dfcb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:50.756568 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3000269d-7697-4457-97d2-15eeef2dfcb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:50.765672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3000269d-7697-4457-97d2-15eeef2dfcb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:50.766447 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3000269d-7697-4457-97d2-15eeef2dfcb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:50.767753 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3000269d-7697-4457-97d2-15eeef2dfcb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:50.769982 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3000269d-7697-4457-97d2-15eeef2dfcb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:50.839201 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0495781b-1139-4e02-bb81-18f295ab39c5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:50.847838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0495781b-1139-4e02-bb81-18f295ab39c5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.182177 Jun 21 16:54:50.848417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 313/647] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:50 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:50.974152 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-71486017-d8d2-4408-b9dd-de64e7d5a754 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:50.974760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-71486017-d8d2-4408-b9dd-de64e7d5a754 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:50.980814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-71486017-d8d2-4408-b9dd-de64e7d5a754 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:50.984110 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-71486017-d8d2-4408-b9dd-de64e7d5a754 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:50.984110 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-71486017-d8d2-4408-b9dd-de64e7d5a754 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:50.984110 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-71486017-d8d2-4408-b9dd-de64e7d5a754 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:51.053461 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3000269d-7697-4457-97d2-15eeef2dfcb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "POST /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/action" status: 202 len: 0 microversion: 2.20 time: 0.302696 Jun 21 16:54:51.054186 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 335/648] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jun 21 16:54:50 2022] POST /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:54:51.064248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:51.064883 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:51.071367 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:51.071821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:51.072595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:51.073032 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:51.120054 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-71486017-d8d2-4408-b9dd-de64e7d5a754 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:51.128237 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-71486017-d8d2-4408-b9dd-de64e7d5a754 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.157968 Jun 21 16:54:51.128809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 314/649] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:50 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:51.209922 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:51.218576 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:51.220091 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:51.223804 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f09e8d70-adf1-4fa2-9423-d00e24622bc3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1673 microversion: 2.20 time: 0.162823 Jun 21 16:54:51.223804 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 336/650] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:51 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:54:51.867433 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f5347547-be22-4fbf-af4b-4a6b915537d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:51.868867 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f5347547-be22-4fbf-af4b-4a6b915537d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:51.876797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f5347547-be22-4fbf-af4b-4a6b915537d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:51.877317 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f5347547-be22-4fbf-af4b-4a6b915537d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:51.878189 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f5347547-be22-4fbf-af4b-4a6b915537d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:51.878867 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f5347547-be22-4fbf-af4b-4a6b915537d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:52.026341 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f5347547-be22-4fbf-af4b-4a6b915537d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:52.035997 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f5347547-be22-4fbf-af4b-4a6b915537d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.174090 Jun 21 16:54:52.036601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 315/651] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:51 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:52.147279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c1437ad3-c194-4b5b-959c-40da205a5399 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:52.147886 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c1437ad3-c194-4b5b-959c-40da205a5399 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:52.155236 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c1437ad3-c194-4b5b-959c-40da205a5399 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:52.155684 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c1437ad3-c194-4b5b-959c-40da205a5399 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:52.156583 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c1437ad3-c194-4b5b-959c-40da205a5399 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:52.157027 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c1437ad3-c194-4b5b-959c-40da205a5399 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:52.239930 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:52.240888 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:52.247242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:52.247690 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:52.249330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:52.249873 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:52.302623 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c1437ad3-c194-4b5b-959c-40da205a5399 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:52.310525 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c1437ad3-c194-4b5b-959c-40da205a5399 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.167600 Jun 21 16:54:52.316503 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 337/652] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:52 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:52.395447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:52.403506 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:52.405493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:52.406655 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0092d3b4-9484-469f-bf00-64510d8f538c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1673 microversion: 2.20 time: 0.171088 Jun 21 16:54:52.407213 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 316/653] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:52 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:54:53.054573 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1a9c10ce-f98a-434d-ad5a-86b597d6f8d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:53.055214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1a9c10ce-f98a-434d-ad5a-86b597d6f8d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:53.061542 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1a9c10ce-f98a-434d-ad5a-86b597d6f8d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:53.063587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1a9c10ce-f98a-434d-ad5a-86b597d6f8d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:53.063587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1a9c10ce-f98a-434d-ad5a-86b597d6f8d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:53.063587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1a9c10ce-f98a-434d-ad5a-86b597d6f8d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:53.207042 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1a9c10ce-f98a-434d-ad5a-86b597d6f8d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:53.214570 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1a9c10ce-f98a-434d-ad5a-86b597d6f8d9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.164442 Jun 21 16:54:53.215315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 338/654] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:53 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:53.328550 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4d6980ca-8f49-464d-ac6f-e9644a894911 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:53.329189 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4d6980ca-8f49-464d-ac6f-e9644a894911 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:53.336046 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4d6980ca-8f49-464d-ac6f-e9644a894911 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:53.336492 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4d6980ca-8f49-464d-ac6f-e9644a894911 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:53.337263 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4d6980ca-8f49-464d-ac6f-e9644a894911 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:53.337738 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4d6980ca-8f49-464d-ac6f-e9644a894911 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:53.424760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:53.425516 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:53.427626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:53.432853 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:53.433424 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:53.434278 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:53.434714 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:53.580216 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:53.589061 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:53.590588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:53.591746 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b366fc36-c792-45f4-ac9b-7b69f70410d8 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.171058 Jun 21 16:54:53.592828 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 339/655] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:53 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:54:53.768343 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4d6980ca-8f49-464d-ac6f-e9644a894911 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:53.776457 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4d6980ca-8f49-464d-ac6f-e9644a894911 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.452275 Jun 21 16:54:53.777069 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 317/656] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:53 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:53.973829 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-816526a1-0452-4a14-81e9-7e23123bc0da req-8c92e330-0c84-4739-a046-15fb8bdad880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c19e657-0d31-410a-b755-4e2d41c926d6", "name": "network-vif-plugged", "status": "completed", "tag": "10e929cc-6721-4663-927d-8eb4ca2d862b"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:54:53.981948 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-816526a1-0452-4a14-81e9-7e23123bc0da req-8c92e330-0c84-4739-a046-15fb8bdad880 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:53.982382 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-816526a1-0452-4a14-81e9-7e23123bc0da req-8c92e330-0c84-4739-a046-15fb8bdad880 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:53.994989 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-816526a1-0452-4a14-81e9-7e23123bc0da req-8c92e330-0c84-4739-a046-15fb8bdad880 service nova] Creating event network-vif-plugged:10e929cc-6721-4663-927d-8eb4ca2d862b for instance 1c19e657-0d31-410a-b755-4e2d41c926d6 on hv-cinder-79987 Jun 21 16:54:54.001320 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-816526a1-0452-4a14-81e9-7e23123bc0da req-8c92e330-0c84-4739-a046-15fb8bdad880 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030828 Jun 21 16:54:54.001933 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 340/657] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:54:54.232047 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b0bcd6fe-b5ad-48cc-975c-64767f0f53de tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:54.232647 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b0bcd6fe-b5ad-48cc-975c-64767f0f53de tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:54.239649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b0bcd6fe-b5ad-48cc-975c-64767f0f53de tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:54.240085 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b0bcd6fe-b5ad-48cc-975c-64767f0f53de tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:54.240831 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b0bcd6fe-b5ad-48cc-975c-64767f0f53de tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:54.241255 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b0bcd6fe-b5ad-48cc-975c-64767f0f53de tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:54.377058 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b0bcd6fe-b5ad-48cc-975c-64767f0f53de tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:54.384769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b0bcd6fe-b5ad-48cc-975c-64767f0f53de tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.156600 Jun 21 16:54:54.385567 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 318/658] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:54 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:54.612688 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:54.613971 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:54.621365 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:54.622033 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:54.622986 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:54.623633 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:54.778540 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:54.788552 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:54.794757 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:54.796596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ef977385-8220-49f2-9274-9e849f70cdad tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.189572 Jun 21 16:54:54.797951 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-399f8c24-7d9f-4c83-88e2-666c334af54d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:54.798666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-399f8c24-7d9f-4c83-88e2-666c334af54d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:54.804921 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 341/659] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:54 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:54.805905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-399f8c24-7d9f-4c83-88e2-666c334af54d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:54.806671 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-399f8c24-7d9f-4c83-88e2-666c334af54d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:54.807541 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-399f8c24-7d9f-4c83-88e2-666c334af54d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:54.808208 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-399f8c24-7d9f-4c83-88e2-666c334af54d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:54.963122 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-399f8c24-7d9f-4c83-88e2-666c334af54d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:54.971823 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-399f8c24-7d9f-4c83-88e2-666c334af54d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.180882 Jun 21 16:54:54.972954 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 319/660] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:54 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:55.402410 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1cd550ef-a964-44e7-9e76-c16db0f4c0f9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:55.403179 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1cd550ef-a964-44e7-9e76-c16db0f4c0f9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:55.405729 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=14 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:54:55.411423 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1cd550ef-a964-44e7-9e76-c16db0f4c0f9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:55.412178 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1cd550ef-a964-44e7-9e76-c16db0f4c0f9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:55.413023 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1cd550ef-a964-44e7-9e76-c16db0f4c0f9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:55.413550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1cd550ef-a964-44e7-9e76-c16db0f4c0f9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:55.575869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1cd550ef-a964-44e7-9e76-c16db0f4c0f9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:55.584097 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1cd550ef-a964-44e7-9e76-c16db0f4c0f9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.185720 Jun 21 16:54:55.590464 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 342/661] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:55 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:55.824002 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:55.824837 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:55.832238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:55.833039 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:55.834078 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:55.834725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:55.981304 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:55.995615 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6973954a-9b8a-47f6-a19c-5e8e8970b267 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:55.996232 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6973954a-9b8a-47f6-a19c-5e8e8970b267 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:56.007053 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6973954a-9b8a-47f6-a19c-5e8e8970b267 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:56.007498 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6973954a-9b8a-47f6-a19c-5e8e8970b267 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:56.008273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6973954a-9b8a-47f6-a19c-5e8e8970b267 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:56.008709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6973954a-9b8a-47f6-a19c-5e8e8970b267 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:56.012963 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:56.015286 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:56.016491 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3ecbb065-9929-4607-8317-faf212f66196 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.196535 Jun 21 16:54:56.019583 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 320/662] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:55 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:56.164258 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6973954a-9b8a-47f6-a19c-5e8e8970b267 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:56.174149 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6973954a-9b8a-47f6-a19c-5e8e8970b267 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.184123 Jun 21 16:54:56.175041 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 343/663] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:55 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:56.601552 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c2fb116a-74c1-480e-bc4d-99a6ed16d061 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:56.602265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c2fb116a-74c1-480e-bc4d-99a6ed16d061 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:56.609409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2fb116a-74c1-480e-bc4d-99a6ed16d061 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:56.610072 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2fb116a-74c1-480e-bc4d-99a6ed16d061 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:56.610997 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2fb116a-74c1-480e-bc4d-99a6ed16d061 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:56.611517 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2fb116a-74c1-480e-bc4d-99a6ed16d061 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:56.780811 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c2fb116a-74c1-480e-bc4d-99a6ed16d061 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:56.790618 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c2fb116a-74c1-480e-bc4d-99a6ed16d061 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.192860 Jun 21 16:54:56.801794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 321/664] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:56 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:57.036655 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:57.037650 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:57.046041 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:57.046584 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:57.047539 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:57.048016 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:57.199199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-610e251f-feb7-4a67-adb5-b5f03fabf1df tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:57.199809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-610e251f-feb7-4a67-adb5-b5f03fabf1df tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:57.207053 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-610e251f-feb7-4a67-adb5-b5f03fabf1df tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:57.207570 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:57.207804 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-610e251f-feb7-4a67-adb5-b5f03fabf1df tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:57.208586 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-610e251f-feb7-4a67-adb5-b5f03fabf1df tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:57.209016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-610e251f-feb7-4a67-adb5-b5f03fabf1df tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:57.216792 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:57.219067 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:57.220269 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-330905e3-f5c6-40d7-8ba1-87e924d6c473 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.188158 Jun 21 16:54:57.221256 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 344/665] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:57 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:57.366321 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-610e251f-feb7-4a67-adb5-b5f03fabf1df tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:57.374162 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-610e251f-feb7-4a67-adb5-b5f03fabf1df tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.178828 Jun 21 16:54:57.374687 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 322/666] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:57 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:54:57.808153 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3f590a60-09fa-4699-900c-2396bd94ea84 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:57.808844 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3f590a60-09fa-4699-900c-2396bd94ea84 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:57.815494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f590a60-09fa-4699-900c-2396bd94ea84 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:57.815937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f590a60-09fa-4699-900c-2396bd94ea84 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:57.816698 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f590a60-09fa-4699-900c-2396bd94ea84 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:57.817129 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f590a60-09fa-4699-900c-2396bd94ea84 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:57.960244 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3f590a60-09fa-4699-900c-2396bd94ea84 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:57.969000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3f590a60-09fa-4699-900c-2396bd94ea84 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.164582 Jun 21 16:54:57.979050 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 345/667] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:57 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:58.239558 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:58.240177 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:58.246862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:58.247313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:58.248080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:58.250040 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:58.392431 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-29ce3bd5-efd1-4bfa-b839-c0c230979196 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:58.393123 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-29ce3bd5-efd1-4bfa-b839-c0c230979196 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:58.399780 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-29ce3bd5-efd1-4bfa-b839-c0c230979196 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:58.400255 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-29ce3bd5-efd1-4bfa-b839-c0c230979196 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:58.400985 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-29ce3bd5-efd1-4bfa-b839-c0c230979196 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:58.401476 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-29ce3bd5-efd1-4bfa-b839-c0c230979196 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:58.405068 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:58.414991 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:58.416502 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:58.417869 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-282f5d7e-cb69-40d4-8427-8f3ce7d866e1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.182298 Jun 21 16:54:58.424337 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 323/668] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:58 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:58.553745 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-29ce3bd5-efd1-4bfa-b839-c0c230979196 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:58.562421 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-29ce3bd5-efd1-4bfa-b839-c0c230979196 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.174797 Jun 21 16:54:58.562994 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 346/669] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:58 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:58.986071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ae9abddf-db5e-4b78-abe3-d8df4a0cbef0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:58.986680 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ae9abddf-db5e-4b78-abe3-d8df4a0cbef0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:58.993073 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae9abddf-db5e-4b78-abe3-d8df4a0cbef0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:58.993557 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae9abddf-db5e-4b78-abe3-d8df4a0cbef0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:58.994315 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae9abddf-db5e-4b78-abe3-d8df4a0cbef0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:58.994752 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae9abddf-db5e-4b78-abe3-d8df4a0cbef0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:59.204103 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ae9abddf-db5e-4b78-abe3-d8df4a0cbef0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:59.213805 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ae9abddf-db5e-4b78-abe3-d8df4a0cbef0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.231385 Jun 21 16:54:59.214717 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 324/670] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:58 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:54:59.437245 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:59.438891 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:59.452794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:59.453706 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:59.454623 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:59.455052 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:59.579988 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c5a4cb08-da2f-4465-aff4-df4895c03634 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:54:59.580676 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c5a4cb08-da2f-4465-aff4-df4895c03634 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:54:59.587668 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c5a4cb08-da2f-4465-aff4-df4895c03634 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:59.588217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c5a4cb08-da2f-4465-aff4-df4895c03634 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:59.589056 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c5a4cb08-da2f-4465-aff4-df4895c03634 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:54:59.589575 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c5a4cb08-da2f-4465-aff4-df4895c03634 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:54:59.674931 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:59.685500 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:59.687867 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:59.689264 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2b9cdcc7-6abd-4789-b4b6-3d1a182f7cab tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.256305 Jun 21 16:54:59.702166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 347/671] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:54:59 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:54:59.756237 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c5a4cb08-da2f-4465-aff4-df4895c03634 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:54:59.763944 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c5a4cb08-da2f-4465-aff4-df4895c03634 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.188214 Jun 21 16:54:59.765128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 325/672] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:54:59 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:00.232898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fcf1daf6-808b-4c31-a8e2-b2198414abef tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:00.234404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fcf1daf6-808b-4c31-a8e2-b2198414abef tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:00.241034 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fcf1daf6-808b-4c31-a8e2-b2198414abef tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:00.241638 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fcf1daf6-808b-4c31-a8e2-b2198414abef tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:00.242483 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fcf1daf6-808b-4c31-a8e2-b2198414abef tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:00.242983 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fcf1daf6-808b-4c31-a8e2-b2198414abef tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:00.386828 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fcf1daf6-808b-4c31-a8e2-b2198414abef tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:00.398570 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fcf1daf6-808b-4c31-a8e2-b2198414abef tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.169760 Jun 21 16:55:00.399260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 348/673] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:00 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:00.708489 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:00.709105 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:00.716080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:00.716535 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:00.717937 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:00.718495 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:00.721263 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:00.781647 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-529d1e6c-ca7e-4af5-86c1-98c401282f6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:00.782281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-529d1e6c-ca7e-4af5-86c1-98c401282f6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:00.788964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-529d1e6c-ca7e-4af5-86c1-98c401282f6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:00.789459 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-529d1e6c-ca7e-4af5-86c1-98c401282f6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:00.790273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-529d1e6c-ca7e-4af5-86c1-98c401282f6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:00.790734 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-529d1e6c-ca7e-4af5-86c1-98c401282f6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:00.897926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:00.910759 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:00.912641 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:00.919548 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c4fe2091-d750-4fd0-a74b-bba4df85f925 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.215100 Jun 21 16:55:00.925908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 326/674] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:00 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:00.980302 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-529d1e6c-ca7e-4af5-86c1-98c401282f6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:00.991754 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-529d1e6c-ca7e-4af5-86c1-98c401282f6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.213981 Jun 21 16:55:01.002277 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 349/675] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:00 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:01.415924 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f2cb4052-e12a-4b5f-870d-7d35cd874a18 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:01.416539 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f2cb4052-e12a-4b5f-870d-7d35cd874a18 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:01.424151 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2cb4052-e12a-4b5f-870d-7d35cd874a18 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:01.424620 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2cb4052-e12a-4b5f-870d-7d35cd874a18 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:01.425430 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2cb4052-e12a-4b5f-870d-7d35cd874a18 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:01.425907 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2cb4052-e12a-4b5f-870d-7d35cd874a18 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:01.563401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f2cb4052-e12a-4b5f-870d-7d35cd874a18 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:01.575256 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f2cb4052-e12a-4b5f-870d-7d35cd874a18 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.163166 Jun 21 16:55:01.576011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 327/676] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:01 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:01.940250 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:01.941090 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:01.948469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:01.949262 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:01.950419 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:01.950959 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:02.009617 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-40bd7b60-377c-409a-8cb4-a4dafb5194a8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:02.011193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-40bd7b60-377c-409a-8cb4-a4dafb5194a8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:02.024732 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-40bd7b60-377c-409a-8cb4-a4dafb5194a8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:02.027521 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-40bd7b60-377c-409a-8cb4-a4dafb5194a8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:02.027521 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-40bd7b60-377c-409a-8cb4-a4dafb5194a8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:02.027521 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-40bd7b60-377c-409a-8cb4-a4dafb5194a8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:02.103026 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:02.113064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:02.115470 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:02.116770 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d2f327c0-108b-4bfb-ac66-4c225643cf25 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.180955 Jun 21 16:55:02.117613 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 350/677] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:01 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:02.203886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-40bd7b60-377c-409a-8cb4-a4dafb5194a8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:02.212217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-40bd7b60-377c-409a-8cb4-a4dafb5194a8 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.207333 Jun 21 16:55:02.213008 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 328/678] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:02 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:02.594011 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8c6b66a5-d584-4bc1-a3c6-3fba6e6b9b0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:02.594602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8c6b66a5-d584-4bc1-a3c6-3fba6e6b9b0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:02.601216 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c6b66a5-d584-4bc1-a3c6-3fba6e6b9b0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:02.602008 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c6b66a5-d584-4bc1-a3c6-3fba6e6b9b0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:02.602786 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c6b66a5-d584-4bc1-a3c6-3fba6e6b9b0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:02.603201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c6b66a5-d584-4bc1-a3c6-3fba6e6b9b0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:02.605977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:02.747458 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8c6b66a5-d584-4bc1-a3c6-3fba6e6b9b0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:02.755643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8c6b66a5-d584-4bc1-a3c6-3fba6e6b9b0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.166430 Jun 21 16:55:02.756408 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 351/679] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:02 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:03.135984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:03.136681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:03.144010 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:03.144455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:03.146023 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:03.146023 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:03.229426 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4f6957f4-02aa-4280-ad4f-f87eee3072d6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:03.230317 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4f6957f4-02aa-4280-ad4f-f87eee3072d6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:03.238350 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4f6957f4-02aa-4280-ad4f-f87eee3072d6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:03.239500 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4f6957f4-02aa-4280-ad4f-f87eee3072d6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:03.240650 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4f6957f4-02aa-4280-ad4f-f87eee3072d6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:03.241232 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4f6957f4-02aa-4280-ad4f-f87eee3072d6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:03.310166 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:03.320802 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:03.322837 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:03.324043 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-17916068-c9dd-4196-8f2f-732dcf743041 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.191983 Jun 21 16:55:03.324795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 329/680] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:03 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:03.390709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4f6957f4-02aa-4280-ad4f-f87eee3072d6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:03.398404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4f6957f4-02aa-4280-ad4f-f87eee3072d6 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.173388 Jun 21 16:55:03.398990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 352/681] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:03 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:03.772986 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-aa2136d2-87cc-438c-9253-52af35f9bdd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:03.773635 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-aa2136d2-87cc-438c-9253-52af35f9bdd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:03.779839 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-aa2136d2-87cc-438c-9253-52af35f9bdd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:03.780479 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-aa2136d2-87cc-438c-9253-52af35f9bdd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:03.781375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-aa2136d2-87cc-438c-9253-52af35f9bdd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:03.781817 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-aa2136d2-87cc-438c-9253-52af35f9bdd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:03.922297 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-aa2136d2-87cc-438c-9253-52af35f9bdd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:03.930663 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-aa2136d2-87cc-438c-9253-52af35f9bdd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.161463 Jun 21 16:55:03.931243 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 330/682] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:03 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:04.344176 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:04.344740 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:04.351214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:04.351652 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:04.352406 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:04.352829 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:04.415674 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c48f0a22-a129-453c-8568-ce40c90a6d13 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:04.416345 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c48f0a22-a129-453c-8568-ce40c90a6d13 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:04.423661 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c48f0a22-a129-453c-8568-ce40c90a6d13 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:04.424108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c48f0a22-a129-453c-8568-ce40c90a6d13 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:04.424860 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c48f0a22-a129-453c-8568-ce40c90a6d13 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:04.425491 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c48f0a22-a129-453c-8568-ce40c90a6d13 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:04.488616 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:04.496735 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:04.499000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:04.499488 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ecc0165c-3e9d-46d7-9766-fca5928b90f3 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.160421 Jun 21 16:55:04.500271 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 353/683] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:04 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:04.567212 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c48f0a22-a129-453c-8568-ce40c90a6d13 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:04.575448 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c48f0a22-a129-453c-8568-ce40c90a6d13 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.163883 Jun 21 16:55:04.576012 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 331/684] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:04 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:04.947248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e56f5ef7-17f2-473e-be0a-31169f0ffcc9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:04.947762 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e56f5ef7-17f2-473e-be0a-31169f0ffcc9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:04.954515 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e56f5ef7-17f2-473e-be0a-31169f0ffcc9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:04.954969 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e56f5ef7-17f2-473e-be0a-31169f0ffcc9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:04.955730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e56f5ef7-17f2-473e-be0a-31169f0ffcc9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:04.956171 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e56f5ef7-17f2-473e-be0a-31169f0ffcc9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:05.098867 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e56f5ef7-17f2-473e-be0a-31169f0ffcc9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:05.106305 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e56f5ef7-17f2-473e-be0a-31169f0ffcc9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.163010 Jun 21 16:55:05.106862 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 354/685] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:04 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:05.519857 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:05.520458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:05.527350 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:05.527729 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:05.528500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:05.528938 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:05.594851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-00ea60a2-6592-4e28-b3fb-429e97e620b9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:05.595649 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-00ea60a2-6592-4e28-b3fb-429e97e620b9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:05.603562 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-00ea60a2-6592-4e28-b3fb-429e97e620b9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:05.603562 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-00ea60a2-6592-4e28-b3fb-429e97e620b9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:05.604183 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-00ea60a2-6592-4e28-b3fb-429e97e620b9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:05.604719 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-00ea60a2-6592-4e28-b3fb-429e97e620b9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:05.682000 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:05.692370 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:05.694014 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:05.695171 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4b634c16-4973-442b-b67a-56a74ba08f4c tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.179666 Jun 21 16:55:05.695809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 332/686] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:05 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:05.763982 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-00ea60a2-6592-4e28-b3fb-429e97e620b9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:05.771894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-00ea60a2-6592-4e28-b3fb-429e97e620b9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.181617 Jun 21 16:55:05.772462 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 355/687] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:05 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:06.125975 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2c9b327b-55e8-44b9-b704-e23063fcc068 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:06.126870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2c9b327b-55e8-44b9-b704-e23063fcc068 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:06.135442 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2c9b327b-55e8-44b9-b704-e23063fcc068 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:06.136166 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2c9b327b-55e8-44b9-b704-e23063fcc068 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:06.137179 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2c9b327b-55e8-44b9-b704-e23063fcc068 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:06.137841 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2c9b327b-55e8-44b9-b704-e23063fcc068 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:06.319553 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2c9b327b-55e8-44b9-b704-e23063fcc068 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:06.327703 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2c9b327b-55e8-44b9-b704-e23063fcc068 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1368 microversion: 2.1 time: 0.207165 Jun 21 16:55:06.330640 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 333/688] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:06 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:06.715752 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:06.716472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:06.724140 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:06.724627 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:06.725495 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:06.725934 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:06.789094 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-25999a15-1b40-4f11-8713-7815b56e853d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:06.789894 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-25999a15-1b40-4f11-8713-7815b56e853d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:06.797087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25999a15-1b40-4f11-8713-7815b56e853d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:06.797636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25999a15-1b40-4f11-8713-7815b56e853d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:06.798463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25999a15-1b40-4f11-8713-7815b56e853d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:06.798970 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-25999a15-1b40-4f11-8713-7815b56e853d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:06.857412 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:06.865515 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:06.867008 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:06.868152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-01d3d6d9-2eda-4d75-89fd-603a5cf334b9 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.157184 Jun 21 16:55:06.868716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 356/689] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:06 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:06.932741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-25999a15-1b40-4f11-8713-7815b56e853d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:06.941084 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-25999a15-1b40-4f11-8713-7815b56e853d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.155826 Jun 21 16:55:06.941665 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 334/690] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:06 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:07.344041 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8c5d23aa-62f2-43ee-9a8c-bf789948802d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:07.344842 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8c5d23aa-62f2-43ee-9a8c-bf789948802d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:07.351177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c5d23aa-62f2-43ee-9a8c-bf789948802d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.351738 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c5d23aa-62f2-43ee-9a8c-bf789948802d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.352234 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c5d23aa-62f2-43ee-9a8c-bf789948802d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.352671 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c5d23aa-62f2-43ee-9a8c-bf789948802d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.488492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8c5d23aa-62f2-43ee-9a8c-bf789948802d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:07.495896 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8c5d23aa-62f2-43ee-9a8c-bf789948802d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1559 microversion: 2.1 time: 0.155715 Jun 21 16:55:07.496451 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 357/691] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:07 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:07.513167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a4548fbd-7d04-4351-bab5-edcfa57b0636 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:07.516188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a4548fbd-7d04-4351-bab5-edcfa57b0636 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:07.519963 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a4548fbd-7d04-4351-bab5-edcfa57b0636 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.520408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a4548fbd-7d04-4351-bab5-edcfa57b0636 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.521224 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a4548fbd-7d04-4351-bab5-edcfa57b0636 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.521684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a4548fbd-7d04-4351-bab5-edcfa57b0636 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.602314 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a4548fbd-7d04-4351-bab5-edcfa57b0636 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092930 Jun 21 16:55:07.602954 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 335/692] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 16:55:07 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:07.836106 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d6950bc0-19e8-4410-8a52-ce969ab6ef6c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:07.837109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d6950bc0-19e8-4410-8a52-ce969ab6ef6c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:07.844301 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d6950bc0-19e8-4410-8a52-ce969ab6ef6c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.844875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d6950bc0-19e8-4410-8a52-ce969ab6ef6c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.845530 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d6950bc0-19e8-4410-8a52-ce969ab6ef6c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.845960 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d6950bc0-19e8-4410-8a52-ce969ab6ef6c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.878590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d6950bc0-19e8-4410-8a52-ce969ab6ef6c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046374 Jun 21 16:55:07.879466 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 358/693] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:55:07 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:07.887072 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:07.888383 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:07.888638 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c61962b7-7f23-47d7-9d8c-ef968a5e397e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:07.889258 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c61962b7-7f23-47d7-9d8c-ef968a5e397e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:07.896105 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.896873 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.897036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c61962b7-7f23-47d7-9d8c-ef968a5e397e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.897692 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c61962b7-7f23-47d7-9d8c-ef968a5e397e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.898094 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.898629 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.898948 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c61962b7-7f23-47d7-9d8c-ef968a5e397e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.899549 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c61962b7-7f23-47d7-9d8c-ef968a5e397e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.941545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c61962b7-7f23-47d7-9d8c-ef968a5e397e tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/900a112e-7b57-40b2-8910-afe246e6c7aa" status: 200 len: 194 microversion: 2.1 time: 0.056489 Jun 21 16:55:07.948174 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 359/694] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jun 21 16:55:07 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/900a112e-7b57-40b2-8910-afe246e6c7aa => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:55:07.959702 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-48e14f97-0dc4-44bd-8ad6-067d97ab4b0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:07.960326 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-48e14f97-0dc4-44bd-8ad6-067d97ab4b0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:07.968724 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-48e14f97-0dc4-44bd-8ad6-067d97ab4b0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.969185 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-48e14f97-0dc4-44bd-8ad6-067d97ab4b0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:07.970010 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-48e14f97-0dc4-44bd-8ad6-067d97ab4b0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:07.970488 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-48e14f97-0dc4-44bd-8ad6-067d97ab4b0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:08.134154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:08.134154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:08.134976 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:08.134976 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3cd664d6-09f1-4fa5-8320-357d300a1d6e tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.215395 Jun 21 16:55:08.134976 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 336/695] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:07 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:08.200739 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-48e14f97-0dc4-44bd-8ad6-067d97ab4b0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:08.213363 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-48e14f97-0dc4-44bd-8ad6-067d97ab4b0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.258163 Jun 21 16:55:08.214229 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 360/696] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:07 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:09.120375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:09.121837 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:09.130521 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:09.131272 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:09.131858 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:09.132404 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:09.233655 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c3690d29-5055-431a-80ba-b0d8efdad13a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:09.235017 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c3690d29-5055-431a-80ba-b0d8efdad13a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:09.242076 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c3690d29-5055-431a-80ba-b0d8efdad13a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:09.242799 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c3690d29-5055-431a-80ba-b0d8efdad13a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:09.243751 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c3690d29-5055-431a-80ba-b0d8efdad13a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:09.244436 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c3690d29-5055-431a-80ba-b0d8efdad13a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:09.423036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c3690d29-5055-431a-80ba-b0d8efdad13a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:09.433290 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c3690d29-5055-431a-80ba-b0d8efdad13a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.203461 Jun 21 16:55:09.434403 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 361/697] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:09 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:09.495223 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:09.504909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:09.506458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:09.507689 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9fbf8065-1f92-4a0d-b1ad-c34f7b0e4e36 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.391456 Jun 21 16:55:09.508574 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 337/698] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:09 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:09.546263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-056e2b0b-d67c-40a8-b2c6-239203c72faf req-f93f5785-3970-495c-bd12-98c5257c1edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c19e657-0d31-410a-b755-4e2d41c926d6", "tag": "10e929cc-6721-4663-927d-8eb4ca2d862b"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:09.554731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-056e2b0b-d67c-40a8-b2c6-239203c72faf req-f93f5785-3970-495c-bd12-98c5257c1edd service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:09.555178 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-056e2b0b-d67c-40a8-b2c6-239203c72faf req-f93f5785-3970-495c-bd12-98c5257c1edd service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:09.566919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-056e2b0b-d67c-40a8-b2c6-239203c72faf req-f93f5785-3970-495c-bd12-98c5257c1edd service nova] Creating event network-changed:10e929cc-6721-4663-927d-8eb4ca2d862b for instance 1c19e657-0d31-410a-b755-4e2d41c926d6 on hv-cinder-79987 Jun 21 16:55:09.572446 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-056e2b0b-d67c-40a8-b2c6-239203c72faf req-f93f5785-3970-495c-bd12-98c5257c1edd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030799 Jun 21 16:55:09.573113 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 362/699] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:10.363039 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-a122511a-b0ee-4f0a-a9ea-59d1aedb9bbc req-7ade83a4-5436-4d33-8ed1-37634d801cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a46d00d-8f66-43bf-990b-e31ab81b9ae0", "name": "network-vif-plugged", "status": "completed", "tag": "9422fb6f-a2be-40f8-9c46-eb984da56a96"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:10.376115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-a122511a-b0ee-4f0a-a9ea-59d1aedb9bbc req-7ade83a4-5436-4d33-8ed1-37634d801cba service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:10.380923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-a122511a-b0ee-4f0a-a9ea-59d1aedb9bbc req-7ade83a4-5436-4d33-8ed1-37634d801cba service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:10.401480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2d349c7d-ac61-4833-999f-dc320d767957 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d20ea35f-eb63-4a56-bb63-95c8808251b2"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:10.403491 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2d349c7d-ac61-4833-999f-dc320d767957 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:10.408332 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-a122511a-b0ee-4f0a-a9ea-59d1aedb9bbc req-7ade83a4-5436-4d33-8ed1-37634d801cba service nova] Creating event network-vif-plugged:9422fb6f-a2be-40f8-9c46-eb984da56a96 for instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 on hv-cinder-79987 Jun 21 16:55:10.416026 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2d349c7d-ac61-4833-999f-dc320d767957 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:10.417812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-a122511a-b0ee-4f0a-a9ea-59d1aedb9bbc req-7ade83a4-5436-4d33-8ed1-37634d801cba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060728 Jun 21 16:55:10.418367 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2d349c7d-ac61-4833-999f-dc320d767957 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:10.419153 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2d349c7d-ac61-4833-999f-dc320d767957 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:10.419582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2d349c7d-ac61-4833-999f-dc320d767957 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:10.425126 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 338/700] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:55:10.454704 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-886e2f44-54a1-4517-bed1-483f153209d1 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:10.455534 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-886e2f44-54a1-4517-bed1-483f153209d1 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:10.464484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-886e2f44-54a1-4517-bed1-483f153209d1 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:10.466038 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-886e2f44-54a1-4517-bed1-483f153209d1 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:10.466975 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-886e2f44-54a1-4517-bed1-483f153209d1 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:10.468162 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-886e2f44-54a1-4517-bed1-483f153209d1 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:10.635905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-886e2f44-54a1-4517-bed1-483f153209d1 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:10.649396 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-886e2f44-54a1-4517-bed1-483f153209d1 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1567 microversion: 2.1 time: 0.201990 Jun 21 16:55:10.650668 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 339/701] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:10 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:10.658477 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:10.659356 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:10.667018 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:10.667494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:10.668382 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:10.668816 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:10.896203 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:10.906020 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:10.907632 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:10.908666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a9ae5a69-d638-42e9-ad09-73ecca0cfdba tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.256534 Jun 21 16:55:10.909224 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 340/702] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:10 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:10.915714 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-074de413-274a-49fc-b533-677c1baac501 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:10.916327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-074de413-274a-49fc-b533-677c1baac501 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:10.922731 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-074de413-274a-49fc-b533-677c1baac501 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:10.923185 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-074de413-274a-49fc-b533-677c1baac501 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:10.923959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-074de413-274a-49fc-b533-677c1baac501 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:10.924396 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-074de413-274a-49fc-b533-677c1baac501 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:11.177458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-074de413-274a-49fc-b533-677c1baac501 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "POST /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4/action" status: 202 len: 0 microversion: 2.1 time: 0.267041 Jun 21 16:55:11.178072 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 341/703] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 16:55:10 2022] POST /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:55:11.182657 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8f333f33-afe2-467c-8bd1-9f2ceb203c24 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:11.183151 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8f333f33-afe2-467c-8bd1-9f2ceb203c24 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:11.190332 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8f333f33-afe2-467c-8bd1-9f2ceb203c24 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:11.190905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8f333f33-afe2-467c-8bd1-9f2ceb203c24 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:11.191717 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8f333f33-afe2-467c-8bd1-9f2ceb203c24 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:11.192152 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8f333f33-afe2-467c-8bd1-9f2ceb203c24 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:11.217880 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8f333f33-afe2-467c-8bd1-9f2ceb203c24 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:55:11.220811 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:11.263222 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2d349c7d-ac61-4833-999f-dc320d767957 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "POST /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.866402 Jun 21 16:55:11.264146 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 363/704] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:55:10 2022] POST /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:11.277596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8984b3e8-69b0-49b3-a046-56c32ee2ea0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:11.278448 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8984b3e8-69b0-49b3-a046-56c32ee2ea0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:11.286037 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8984b3e8-69b0-49b3-a046-56c32ee2ea0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:11.286544 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8984b3e8-69b0-49b3-a046-56c32ee2ea0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:11.287427 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8984b3e8-69b0-49b3-a046-56c32ee2ea0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:11.287882 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8984b3e8-69b0-49b3-a046-56c32ee2ea0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:11.437805 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8984b3e8-69b0-49b3-a046-56c32ee2ea0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:11.445894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8984b3e8-69b0-49b3-a046-56c32ee2ea0a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1515 microversion: 2.1 time: 0.180282 Jun 21 16:55:11.446709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 364/705] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:11 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:11.550676 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8f333f33-afe2-467c-8bd1-9f2ceb203c24 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 204 len: 0 microversion: 2.1 time: 0.371254 Jun 21 16:55:11.551615 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 342/706] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:55:11 2022] DELETE /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:55:11.561718 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9c49ec80-d384-4fd9-866b-2f936f11905b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:11.561718 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9c49ec80-d384-4fd9-866b-2f936f11905b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:11.566614 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9c49ec80-d384-4fd9-866b-2f936f11905b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:11.567063 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9c49ec80-d384-4fd9-866b-2f936f11905b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:11.567849 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9c49ec80-d384-4fd9-866b-2f936f11905b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:11.568283 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9c49ec80-d384-4fd9-866b-2f936f11905b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:11.712706 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9c49ec80-d384-4fd9-866b-2f936f11905b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:11.725573 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9c49ec80-d384-4fd9-866b-2f936f11905b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1577 microversion: 2.1 time: 0.169571 Jun 21 16:55:11.736563 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 365/707] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:11 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:11.927890 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:11.928667 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:11.935203 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:11.935520 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:11.936384 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:11.936384 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:12.081791 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:12.089887 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:12.091399 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:12.092598 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-56a8a75b-fe39-4eb5-b297-0d1e77cf487f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.169317 Jun 21 16:55:12.093155 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 343/708] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:11 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:12.463395 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-38eb6401-2f91-4e06-911d-feaae59cacda tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:12.464034 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-38eb6401-2f91-4e06-911d-feaae59cacda tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:12.470285 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-38eb6401-2f91-4e06-911d-feaae59cacda tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:12.470838 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-38eb6401-2f91-4e06-911d-feaae59cacda tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:12.471586 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-38eb6401-2f91-4e06-911d-feaae59cacda tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:12.472016 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-38eb6401-2f91-4e06-911d-feaae59cacda tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:12.617370 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-38eb6401-2f91-4e06-911d-feaae59cacda tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:12.625719 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-38eb6401-2f91-4e06-911d-feaae59cacda tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1515 microversion: 2.1 time: 0.166078 Jun 21 16:55:12.626313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 366/709] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:12 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:12.743660 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c572fb81-6a82-49d5-85ee-7959ff1560aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:12.744258 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c572fb81-6a82-49d5-85ee-7959ff1560aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:12.751483 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c572fb81-6a82-49d5-85ee-7959ff1560aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:12.752188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c572fb81-6a82-49d5-85ee-7959ff1560aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:12.752941 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c572fb81-6a82-49d5-85ee-7959ff1560aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:12.753411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c572fb81-6a82-49d5-85ee-7959ff1560aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:12.884739 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c572fb81-6a82-49d5-85ee-7959ff1560aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:12.893051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c572fb81-6a82-49d5-85ee-7959ff1560aa tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1577 microversion: 2.1 time: 0.153364 Jun 21 16:55:12.893663 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 344/710] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:12 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:13.111567 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:13.112084 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:13.118509 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:13.118956 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:13.119730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:13.120155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:13.122828 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:13.268166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:13.277002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:13.278586 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:13.281760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-276a7b59-17e5-4932-95e1-166f116ea737 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.172876 Jun 21 16:55:13.281760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 367/711] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:13 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:13.643876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fee3f440-9b57-4a40-8322-ffc713f82e6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:13.644603 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-fee3f440-9b57-4a40-8322-ffc713f82e6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:13.650723 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fee3f440-9b57-4a40-8322-ffc713f82e6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:13.651166 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fee3f440-9b57-4a40-8322-ffc713f82e6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:13.651912 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fee3f440-9b57-4a40-8322-ffc713f82e6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:13.652331 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fee3f440-9b57-4a40-8322-ffc713f82e6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:13.793909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fee3f440-9b57-4a40-8322-ffc713f82e6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:13.802921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fee3f440-9b57-4a40-8322-ffc713f82e6b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1515 microversion: 2.1 time: 0.163708 Jun 21 16:55:13.803699 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 345/712] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:13 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:13.910739 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a557afb5-1e87-4e96-a1cb-4f33366b8c3f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:13.911348 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a557afb5-1e87-4e96-a1cb-4f33366b8c3f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:13.917435 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a557afb5-1e87-4e96-a1cb-4f33366b8c3f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:13.917891 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a557afb5-1e87-4e96-a1cb-4f33366b8c3f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:13.918708 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a557afb5-1e87-4e96-a1cb-4f33366b8c3f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:13.919149 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a557afb5-1e87-4e96-a1cb-4f33366b8c3f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:14.022415 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-55eb797c-8b40-41ba-a6c2-3cdfcd9b61cf req-c5eb00af-0dcb-4e1f-9f35-7ee174b57af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff16739-f953-4e6d-9c9c-c283d8ed7c33", "name": "network-vif-unplugged", "status": "completed", "tag": "3b782323-0e20-4ed4-9fde-029d430c7e0e"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:14.035511 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-55eb797c-8b40-41ba-a6c2-3cdfcd9b61cf req-c5eb00af-0dcb-4e1f-9f35-7ee174b57af1 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:14.035960 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-55eb797c-8b40-41ba-a6c2-3cdfcd9b61cf req-c5eb00af-0dcb-4e1f-9f35-7ee174b57af1 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:14.055575 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-55eb797c-8b40-41ba-a6c2-3cdfcd9b61cf req-c5eb00af-0dcb-4e1f-9f35-7ee174b57af1 service nova] Creating event network-vif-unplugged:3b782323-0e20-4ed4-9fde-029d430c7e0e for instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 on hv-cinder-79987 Jun 21 16:55:14.061019 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-55eb797c-8b40-41ba-a6c2-3cdfcd9b61cf req-c5eb00af-0dcb-4e1f-9f35-7ee174b57af1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042332 Jun 21 16:55:14.065488 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 346/713] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:14.069553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a557afb5-1e87-4e96-a1cb-4f33366b8c3f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:14.077685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a557afb5-1e87-4e96-a1cb-4f33366b8c3f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1577 microversion: 2.1 time: 0.170607 Jun 21 16:55:14.078255 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 368/714] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:13 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:14.300681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:14.301463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:14.307813 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:14.308258 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:14.309026 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:14.309486 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:14.799733 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:14.809907 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:14.812019 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:14.813190 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a8ba1364-7e9d-4cd5-803e-269dfc3393e5 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1731 microversion: 2.20 time: 0.518294 Jun 21 16:55:14.822680 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ec0f25d8-4d8f-4ee4-bc2f-50864cdf5e61 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:14.823528 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ec0f25d8-4d8f-4ee4-bc2f-50864cdf5e61 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:14.827713 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 347/715] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:14 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1731 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:14.831156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ec0f25d8-4d8f-4ee4-bc2f-50864cdf5e61 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:14.831605 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ec0f25d8-4d8f-4ee4-bc2f-50864cdf5e61 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:14.832500 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ec0f25d8-4d8f-4ee4-bc2f-50864cdf5e61 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:14.832957 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ec0f25d8-4d8f-4ee4-bc2f-50864cdf5e61 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:14.984646 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ec0f25d8-4d8f-4ee4-bc2f-50864cdf5e61 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:14.992822 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ec0f25d8-4d8f-4ee4-bc2f-50864cdf5e61 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1517 microversion: 2.1 time: 0.176676 Jun 21 16:55:14.993643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 369/716] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:14 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:15.096016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cbed4d7f-c5b7-4dfa-9121-7d812d190777 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:15.096678 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cbed4d7f-c5b7-4dfa-9121-7d812d190777 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:15.104401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbed4d7f-c5b7-4dfa-9121-7d812d190777 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:15.105911 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbed4d7f-c5b7-4dfa-9121-7d812d190777 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:15.107618 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbed4d7f-c5b7-4dfa-9121-7d812d190777 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:15.110316 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbed4d7f-c5b7-4dfa-9121-7d812d190777 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:15.208273 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cbed4d7f-c5b7-4dfa-9121-7d812d190777 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:15.216179 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cbed4d7f-c5b7-4dfa-9121-7d812d190777 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1510 microversion: 2.1 time: 0.125052 Jun 21 16:55:15.217076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 348/717] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:15 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1510 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:15.457157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-08caebb8-b004-404c-b379-1fd5e8f82aa8 req-df2836b3-7a5e-4bd8-b1e2-3365016cd0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff16739-f953-4e6d-9c9c-c283d8ed7c33", "name": "network-vif-deleted", "tag": "3b782323-0e20-4ed4-9fde-029d430c7e0e"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:15.466511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-08caebb8-b004-404c-b379-1fd5e8f82aa8 req-df2836b3-7a5e-4bd8-b1e2-3365016cd0e8 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:15.475339 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-08caebb8-b004-404c-b379-1fd5e8f82aa8 req-df2836b3-7a5e-4bd8-b1e2-3365016cd0e8 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:15.482152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-08caebb8-b004-404c-b379-1fd5e8f82aa8 req-df2836b3-7a5e-4bd8-b1e2-3365016cd0e8 service nova] Creating event network-vif-deleted:3b782323-0e20-4ed4-9fde-029d430c7e0e for instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 on hv-cinder-79987 Jun 21 16:55:15.489546 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-08caebb8-b004-404c-b379-1fd5e8f82aa8 req-df2836b3-7a5e-4bd8-b1e2-3365016cd0e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038037 Jun 21 16:55:15.490158 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 370/718] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:15.834275 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:15.834900 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:15.841535 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:15.841982 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:15.846496 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:15.846496 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:16.012971 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f8391472-6b2f-4e0f-a894-2bb7102536bf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:16.015380 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f8391472-6b2f-4e0f-a894-2bb7102536bf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:16.017179 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:16.021523 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=100 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:16.023731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8391472-6b2f-4e0f-a894-2bb7102536bf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:16.024184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8391472-6b2f-4e0f-a894-2bb7102536bf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:16.025186 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8391472-6b2f-4e0f-a894-2bb7102536bf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:16.025820 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f8391472-6b2f-4e0f-a894-2bb7102536bf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:16.036851 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:16.039559 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:16.040587 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2868d2fb-13fd-4eb8-be39-e13cfe75ea83 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1718 microversion: 2.20 time: 0.210376 Jun 21 16:55:16.053604 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 349/719] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:15 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1718 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:16.099673 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-5c01aeec-8ed4-4aff-967c-790437c825ee req-05cc30b4-77ad-4479-ad5d-a400c9cc8ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c7a8e0-22b7-46fd-8a39-03e153ce2dc4", "name": "network-vif-unplugged", "status": "completed", "tag": "abae0918-ee64-4a4d-89a7-fad9196b8160"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:16.108267 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-5c01aeec-8ed4-4aff-967c-790437c825ee req-05cc30b4-77ad-4479-ad5d-a400c9cc8ea9 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:16.108839 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-5c01aeec-8ed4-4aff-967c-790437c825ee req-05cc30b4-77ad-4479-ad5d-a400c9cc8ea9 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:16.122905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.compute.server_external_events [req-5c01aeec-8ed4-4aff-967c-790437c825ee req-05cc30b4-77ad-4479-ad5d-a400c9cc8ea9 service nova] Unable to find a host for instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4. Dropping event network-vif-unplugged {{(pid=124686) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 16:55:16.124345 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-5c01aeec-8ed4-4aff-967c-790437c825ee req-05cc30b4-77ad-4479-ad5d-a400c9cc8ea9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028169 Jun 21 16:55:16.125514 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 350/720] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 16:55:16.195216 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f8391472-6b2f-4e0f-a894-2bb7102536bf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:16.208753 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f8391472-6b2f-4e0f-a894-2bb7102536bf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1517 microversion: 2.1 time: 0.200821 Jun 21 16:55:16.209366 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 371/721] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:16 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1517 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:16.234100 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:16.234714 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:16.241499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:16.241944 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:16.242721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:16.243151 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:16.288427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:16.289155 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:16.289932 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lazy-loading 'fault' on Instance uuid cff16739-f953-4e6d-9c9c-c283d8ed7c33 {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:55:16.339975 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:16.351159 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bbc80a0e-1832-4198-8ec1-0b8b474157b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 200 len: 1231 microversion: 2.1 time: 0.121059 Jun 21 16:55:16.351746 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 351/722] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:16 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 1231 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:17.226820 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-66bec8db-974c-46eb-8bd3-bdd0478318a7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:17.227436 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-66bec8db-974c-46eb-8bd3-bdd0478318a7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:17.234725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-66bec8db-974c-46eb-8bd3-bdd0478318a7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:17.235168 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-66bec8db-974c-46eb-8bd3-bdd0478318a7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:17.235927 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-66bec8db-974c-46eb-8bd3-bdd0478318a7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:17.236383 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-66bec8db-974c-46eb-8bd3-bdd0478318a7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:17.368701 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:17.369259 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:17.371749 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:17.373412 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-66bec8db-974c-46eb-8bd3-bdd0478318a7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:17.376754 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:17.377615 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:17.378392 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:17.378897 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:17.389319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-66bec8db-974c-46eb-8bd3-bdd0478318a7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1517 microversion: 2.1 time: 0.158532 Jun 21 16:55:17.389319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 372/723] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:17 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:17.393493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] HTTP exception thrown: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Request method failure captured: Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 HTTP/1.1 Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfc6mLtJWhgynj42LzZ-zWY63rQIWwprMnpkRdQI4LsmxukSe55XHPfLk8nJMo1S4O10_tuQsmwIFd6xIuAWjy4RKkNV7hHolZVFwtnVF4VVieX0JM9DlTTyFk5Z3rQ4rgCMJ48OkhhWCJjeUl-ttjC2uv5L9Nm9Bk3-LS5oSa9ZpPU Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:55:17.395216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7a8a0ae0c16a41c8b34547406830813a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-TestVolumeBootPattern-415641267 Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-TestVolumeBootPattern-415641267-project Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 0ebe6382afe24ef489261081e8610271 Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-TestVolumeBootPattern-415641267-project Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 16:55:17.396848 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': 'cff16739-f953-4e6d-9c9c-c283d8ed7c33'} Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:55:17.397778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 16:55:17.399251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:17.400801 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Returning 404 to user: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:55:17.400801 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d188bb7a-61c4-4097-866e-a3698d49996e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 404 len: 111 microversion: 2.1 time: 0.032083 Jun 21 16:55:17.400801 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 352/724] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:17 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 16:55:17.493761 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-480816062", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1039709549", "security_groups": [{"name": "tempest-secgroup-smoke-254481239"}], "block_device_mapping_v2": [{"uuid": "31416ee1-486f-43fe-a753-6d1bbb824d34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c20083da-e0ff-47bb-b753-e54f100e0a6f"}]}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:17.605459 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] validate_networks() for [('c20083da-e0ff-47bb-b753-e54f100e0a6f', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:55:17.979690 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:55:17.980109 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:55:17.980580 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:55:17.980989 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:55:17.981426 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:55:17.991879 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:17.992409 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:17.993553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:17.993991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:18.012342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Getting quotas for project 7a8a0ae0c16a41c8b34547406830813a. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:55:18.017657 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Getting quotas for user 0ebe6382afe24ef489261081e8610271 and project 7a8a0ae0c16a41c8b34547406830813a. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:55:18.075309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:55:18.078189 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31416ee1-486f-43fe-a753-6d1bbb824d34',volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:55:18.399309 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-69ad7689-dd67-4486-b9c8-4ad5f6f29ddd tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:18.400074 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-69ad7689-dd67-4486-b9c8-4ad5f6f29ddd tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:18.407136 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-69ad7689-dd67-4486-b9c8-4ad5f6f29ddd tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:18.412154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-69ad7689-dd67-4486-b9c8-4ad5f6f29ddd tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:18.412154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-69ad7689-dd67-4486-b9c8-4ad5f6f29ddd tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:18.412154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-69ad7689-dd67-4486-b9c8-4ad5f6f29ddd tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:18.500144 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f814b0ef-6fbd-4fac-b0e1-9c1b1baf0226 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.010423 Jun 21 16:55:18.507073 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 373/725] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:55:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 16:55:18.512395 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-092ab67e-73b9-4142-a746-f17926f73302 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:18.513010 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-092ab67e-73b9-4142-a746-f17926f73302 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:18.556562 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-69ad7689-dd67-4486-b9c8-4ad5f6f29ddd tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:18.566279 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-69ad7689-dd67-4486-b9c8-4ad5f6f29ddd tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1517 microversion: 2.1 time: 0.171144 Jun 21 16:55:18.567190 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 353/726] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:18 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:18.582304 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-092ab67e-73b9-4142-a746-f17926f73302 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:18.588891 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-092ab67e-73b9-4142-a746-f17926f73302 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1094 microversion: 2.1 time: 0.080459 Jun 21 16:55:18.589481 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 374/727] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:18 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:19.584078 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-21941385-419e-4e22-8bf9-2c0584a42afb tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:19.584716 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-21941385-419e-4e22-8bf9-2c0584a42afb tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:19.591368 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-21941385-419e-4e22-8bf9-2c0584a42afb tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:19.591814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-21941385-419e-4e22-8bf9-2c0584a42afb tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:19.592581 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-21941385-419e-4e22-8bf9-2c0584a42afb tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:19.593018 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-21941385-419e-4e22-8bf9-2c0584a42afb tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:19.605953 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-193e4846-4208-47d3-a51d-9030b933d80f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:19.606550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-193e4846-4208-47d3-a51d-9030b933d80f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:19.614108 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-193e4846-4208-47d3-a51d-9030b933d80f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:19.614551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-193e4846-4208-47d3-a51d-9030b933d80f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:19.615344 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-193e4846-4208-47d3-a51d-9030b933d80f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:19.615772 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-193e4846-4208-47d3-a51d-9030b933d80f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:19.685186 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-193e4846-4208-47d3-a51d-9030b933d80f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:19.693604 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-193e4846-4208-47d3-a51d-9030b933d80f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1144 microversion: 2.1 time: 0.091337 Jun 21 16:55:19.694175 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 375/728] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:19 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:19.735847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-21941385-419e-4e22-8bf9-2c0584a42afb tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:19.743419 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-21941385-419e-4e22-8bf9-2c0584a42afb tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1517 microversion: 2.1 time: 0.163259 Jun 21 16:55:19.743998 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 354/729] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:19 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:20.710595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e2212bbb-1550-4995-994f-171f60815c12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:20.711156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e2212bbb-1550-4995-994f-171f60815c12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:20.719548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e2212bbb-1550-4995-994f-171f60815c12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:20.720005 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e2212bbb-1550-4995-994f-171f60815c12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:20.720786 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e2212bbb-1550-4995-994f-171f60815c12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:20.721356 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e2212bbb-1550-4995-994f-171f60815c12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:20.762527 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c1088d2e-49ea-4500-86df-aed2c4dc66ac tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:20.763192 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c1088d2e-49ea-4500-86df-aed2c4dc66ac tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:20.770841 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c1088d2e-49ea-4500-86df-aed2c4dc66ac tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:20.771283 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c1088d2e-49ea-4500-86df-aed2c4dc66ac tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:20.772040 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c1088d2e-49ea-4500-86df-aed2c4dc66ac tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:20.772462 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c1088d2e-49ea-4500-86df-aed2c4dc66ac tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:20.786663 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e2212bbb-1550-4995-994f-171f60815c12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:20.794049 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e2212bbb-1550-4995-994f-171f60815c12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1192 microversion: 2.1 time: 0.087516 Jun 21 16:55:20.794812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 376/730] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:20 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:20.916772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c1088d2e-49ea-4500-86df-aed2c4dc66ac tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:20.924494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c1088d2e-49ea-4500-86df-aed2c4dc66ac tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1517 microversion: 2.1 time: 0.166495 Jun 21 16:55:20.925062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 355/731] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:20 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:20.945611 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5a21ebbf-9a77-47ed-a04f-6cddc88d27bc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:20.946594 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5a21ebbf-9a77-47ed-a04f-6cddc88d27bc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:20.953151 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5a21ebbf-9a77-47ed-a04f-6cddc88d27bc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:20.953696 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5a21ebbf-9a77-47ed-a04f-6cddc88d27bc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:20.954444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5a21ebbf-9a77-47ed-a04f-6cddc88d27bc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:20.954987 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5a21ebbf-9a77-47ed-a04f-6cddc88d27bc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:20.985496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5a21ebbf-9a77-47ed-a04f-6cddc88d27bc tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043770 Jun 21 16:55:20.986193 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 377/732] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:55:20 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:21.127119 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8c4f2fa6-cfab-4b64-9cf9-ccb6a605aac0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:21.127876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8c4f2fa6-cfab-4b64-9cf9-ccb6a605aac0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:21.134026 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8c4f2fa6-cfab-4b64-9cf9-ccb6a605aac0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:21.134479 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8c4f2fa6-cfab-4b64-9cf9-ccb6a605aac0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:21.135286 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8c4f2fa6-cfab-4b64-9cf9-ccb6a605aac0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:21.135721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8c4f2fa6-cfab-4b64-9cf9-ccb6a605aac0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:21.164780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8c4f2fa6-cfab-4b64-9cf9-ccb6a605aac0 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/900a112e-7b57-40b2-8910-afe246e6c7aa" status: 200 len: 194 microversion: 2.1 time: 0.042352 Jun 21 16:55:21.165403 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 356/733] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jun 21 16:55:21 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/900a112e-7b57-40b2-8910-afe246e6c7aa => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:21.175713 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f59751b5-1d59-4a90-85ac-610d69009e7b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:21.176322 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f59751b5-1d59-4a90-85ac-610d69009e7b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:21.182650 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f59751b5-1d59-4a90-85ac-610d69009e7b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:21.183133 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f59751b5-1d59-4a90-85ac-610d69009e7b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:21.183884 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f59751b5-1d59-4a90-85ac-610d69009e7b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:21.184308 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f59751b5-1d59-4a90-85ac-610d69009e7b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:21.280686 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-f59751b5-1d59-4a90-85ac-610d69009e7b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lazy-loading 'services' on Instance uuid 99ae4eba-c5bd-4271-8d4b-231ffc992e4d {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:55:21.537077 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f59751b5-1d59-4a90-85ac-610d69009e7b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "DELETE /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/900a112e-7b57-40b2-8910-afe246e6c7aa" status: 202 len: 0 microversion: 2.1 time: 0.365637 Jun 21 16:55:21.540942 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 378/734] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 16:55:21 2022] DELETE /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/900a112e-7b57-40b2-8910-afe246e6c7aa => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:55:21.815480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a676c702-ada9-4a0d-ae9d-066940d1665f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:21.816087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a676c702-ada9-4a0d-ae9d-066940d1665f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:21.822830 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a676c702-ada9-4a0d-ae9d-066940d1665f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:21.823277 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a676c702-ada9-4a0d-ae9d-066940d1665f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:21.824042 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a676c702-ada9-4a0d-ae9d-066940d1665f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:21.824473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a676c702-ada9-4a0d-ae9d-066940d1665f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:21.896386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a676c702-ada9-4a0d-ae9d-066940d1665f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:21.904704 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a676c702-ada9-4a0d-ae9d-066940d1665f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1210 microversion: 2.1 time: 0.093878 Jun 21 16:55:21.906661 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 357/735] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:21 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:21.944530 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-57fe1c90-5bc4-4a29-a687-7f3d8b61e2ba tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:21.945407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-57fe1c90-5bc4-4a29-a687-7f3d8b61e2ba tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:21.953182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-57fe1c90-5bc4-4a29-a687-7f3d8b61e2ba tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:21.953757 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-57fe1c90-5bc4-4a29-a687-7f3d8b61e2ba tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:21.954617 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-57fe1c90-5bc4-4a29-a687-7f3d8b61e2ba tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:21.955196 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-57fe1c90-5bc4-4a29-a687-7f3d8b61e2ba tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:22.096996 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-57fe1c90-5bc4-4a29-a687-7f3d8b61e2ba tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:22.104669 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-57fe1c90-5bc4-4a29-a687-7f3d8b61e2ba tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1517 microversion: 2.1 time: 0.164382 Jun 21 16:55:22.105228 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 379/736] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:21 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:22.923501 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1d49c686-e2f8-4eaa-b815-8a71520726b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:22.924037 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1d49c686-e2f8-4eaa-b815-8a71520726b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:22.930972 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1d49c686-e2f8-4eaa-b815-8a71520726b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:22.931439 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1d49c686-e2f8-4eaa-b815-8a71520726b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:22.932207 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1d49c686-e2f8-4eaa-b815-8a71520726b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:22.932639 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1d49c686-e2f8-4eaa-b815-8a71520726b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:23.081105 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1d49c686-e2f8-4eaa-b815-8a71520726b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:23.090654 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1d49c686-e2f8-4eaa-b815-8a71520726b8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1277 microversion: 2.1 time: 0.170218 Jun 21 16:55:23.090654 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 358/737] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:22 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:23.122321 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2feda29e-4119-40ef-8e98-636ae057153a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:23.123003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2feda29e-4119-40ef-8e98-636ae057153a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:23.137067 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2feda29e-4119-40ef-8e98-636ae057153a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:23.138357 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2feda29e-4119-40ef-8e98-636ae057153a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:23.140003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2feda29e-4119-40ef-8e98-636ae057153a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:23.140638 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2feda29e-4119-40ef-8e98-636ae057153a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:23.328298 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2feda29e-4119-40ef-8e98-636ae057153a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:23.337245 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2feda29e-4119-40ef-8e98-636ae057153a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.218670 Jun 21 16:55:23.337858 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 380/738] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:23 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:23.505585 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-bf480918-62cf-419e-893f-52ab1b6ed1fc req-95d5182d-7783-4747-bb4b-7bd1e1df69d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdcabcd-b09e-4215-9fd3-914201278c7d", "tag": "b654ed50-66dd-4643-897e-9f5c0d189bff"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:23.514203 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-bf480918-62cf-419e-893f-52ab1b6ed1fc req-95d5182d-7783-4747-bb4b-7bd1e1df69d2 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:23.515397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-bf480918-62cf-419e-893f-52ab1b6ed1fc req-95d5182d-7783-4747-bb4b-7bd1e1df69d2 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:23.526825 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-bf480918-62cf-419e-893f-52ab1b6ed1fc req-95d5182d-7783-4747-bb4b-7bd1e1df69d2 service nova] Creating event network-changed:b654ed50-66dd-4643-897e-9f5c0d189bff for instance ebdcabcd-b09e-4215-9fd3-914201278c7d on hv-cinder-79987 Jun 21 16:55:23.533535 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-bf480918-62cf-419e-893f-52ab1b6ed1fc req-95d5182d-7783-4747-bb4b-7bd1e1df69d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032006 Jun 21 16:55:23.534820 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 359/739] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:24.107190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-47f7683c-21ef-444a-af0f-2a1d17683964 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:24.107899 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-47f7683c-21ef-444a-af0f-2a1d17683964 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:24.115791 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-47f7683c-21ef-444a-af0f-2a1d17683964 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:24.116315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-47f7683c-21ef-444a-af0f-2a1d17683964 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:24.117487 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-47f7683c-21ef-444a-af0f-2a1d17683964 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:24.117923 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-47f7683c-21ef-444a-af0f-2a1d17683964 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:24.257622 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-47f7683c-21ef-444a-af0f-2a1d17683964 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:24.268607 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-47f7683c-21ef-444a-af0f-2a1d17683964 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.165350 Jun 21 16:55:24.269793 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 381/740] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:24 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:24.356090 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bfd6ba03-5245-4755-9d40-a238faed0fc3 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:24.356845 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bfd6ba03-5245-4755-9d40-a238faed0fc3 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:24.363971 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfd6ba03-5245-4755-9d40-a238faed0fc3 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:24.364411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfd6ba03-5245-4755-9d40-a238faed0fc3 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:24.365304 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfd6ba03-5245-4755-9d40-a238faed0fc3 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:24.365752 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfd6ba03-5245-4755-9d40-a238faed0fc3 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:24.368968 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:24.508492 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bfd6ba03-5245-4755-9d40-a238faed0fc3 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:24.516877 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bfd6ba03-5245-4755-9d40-a238faed0fc3 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.165640 Jun 21 16:55:24.517492 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 360/741] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:24 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:24.793506 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b72d55f2-232c-4d59-8d64-50ca047e6c6b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:24.794008 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b72d55f2-232c-4d59-8d64-50ca047e6c6b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:24.800621 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b72d55f2-232c-4d59-8d64-50ca047e6c6b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:24.801070 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b72d55f2-232c-4d59-8d64-50ca047e6c6b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:24.801888 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b72d55f2-232c-4d59-8d64-50ca047e6c6b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:24.802322 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b72d55f2-232c-4d59-8d64-50ca047e6c6b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:24.834634 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b72d55f2-232c-4d59-8d64-50ca047e6c6b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/d20ea35f-eb63-4a56-bb63-95c8808251b2" status: 200 len: 194 microversion: 2.1 time: 0.045085 Jun 21 16:55:24.835239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 382/742] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jun 21 16:55:24 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/d20ea35f-eb63-4a56-bb63-95c8808251b2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:24.845902 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-caefe3f1-2705-4ea6-89bb-2468e14fe8fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:24.846408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-caefe3f1-2705-4ea6-89bb-2468e14fe8fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:24.853041 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-caefe3f1-2705-4ea6-89bb-2468e14fe8fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:24.853535 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-caefe3f1-2705-4ea6-89bb-2468e14fe8fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:24.854294 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-caefe3f1-2705-4ea6-89bb-2468e14fe8fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:24.854732 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-caefe3f1-2705-4ea6-89bb-2468e14fe8fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:24.939304 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-caefe3f1-2705-4ea6-89bb-2468e14fe8fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lazy-loading 'services' on Instance uuid 99ae4eba-c5bd-4271-8d4b-231ffc992e4d {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:55:25.154778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-caefe3f1-2705-4ea6-89bb-2468e14fe8fa tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "DELETE /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/d20ea35f-eb63-4a56-bb63-95c8808251b2" status: 202 len: 0 microversion: 2.1 time: 0.313104 Jun 21 16:55:25.155433 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 361/743] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 16:55:24 2022] DELETE /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments/d20ea35f-eb63-4a56-bb63-95c8808251b2 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:55:25.285504 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0cddc75b-f997-4788-aab5-5c5759068d06 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:25.286125 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0cddc75b-f997-4788-aab5-5c5759068d06 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:25.293178 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0cddc75b-f997-4788-aab5-5c5759068d06 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:25.293668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0cddc75b-f997-4788-aab5-5c5759068d06 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:25.294442 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0cddc75b-f997-4788-aab5-5c5759068d06 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:25.294879 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0cddc75b-f997-4788-aab5-5c5759068d06 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:25.432227 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0cddc75b-f997-4788-aab5-5c5759068d06 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:25.440521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0cddc75b-f997-4788-aab5-5c5759068d06 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.159051 Jun 21 16:55:25.441062 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 383/744] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:25 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:25.535637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f9bbe342-f777-4053-990e-71fef38bd6ef tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:25.536324 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f9bbe342-f777-4053-990e-71fef38bd6ef tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:25.542628 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9bbe342-f777-4053-990e-71fef38bd6ef tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:25.543060 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9bbe342-f777-4053-990e-71fef38bd6ef tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:25.543837 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9bbe342-f777-4053-990e-71fef38bd6ef tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:25.544260 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9bbe342-f777-4053-990e-71fef38bd6ef tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:25.962215 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f9bbe342-f777-4053-990e-71fef38bd6ef tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:25.969891 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f9bbe342-f777-4053-990e-71fef38bd6ef tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.438862 Jun 21 16:55:25.972055 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 362/745] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:25 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:26.318868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ad088ed7-4f90-4abe-9c24-c576289cab15 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:26.319846 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ad088ed7-4f90-4abe-9c24-c576289cab15 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:26.326983 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ad088ed7-4f90-4abe-9c24-c576289cab15 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.327422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ad088ed7-4f90-4abe-9c24-c576289cab15 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:26.328195 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ad088ed7-4f90-4abe-9c24-c576289cab15 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.328626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ad088ed7-4f90-4abe-9c24-c576289cab15 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:26.360251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ad088ed7-4f90-4abe-9c24-c576289cab15 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045331 Jun 21 16:55:26.360812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 384/746] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:55:26 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:55:26.457507 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4c61b0d9-2ac9-4a35-9d16-0f54b84a8bb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:26.458015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4c61b0d9-2ac9-4a35-9d16-0f54b84a8bb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:26.464644 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4c61b0d9-2ac9-4a35-9d16-0f54b84a8bb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.465089 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4c61b0d9-2ac9-4a35-9d16-0f54b84a8bb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:26.465886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4c61b0d9-2ac9-4a35-9d16-0f54b84a8bb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.466280 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e659cd43-4cba-4d80-893a-5f096c64e33a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:26.466386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4c61b0d9-2ac9-4a35-9d16-0f54b84a8bb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:26.467210 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e659cd43-4cba-4d80-893a-5f096c64e33a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:26.474527 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e659cd43-4cba-4d80-893a-5f096c64e33a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.474968 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e659cd43-4cba-4d80-893a-5f096c64e33a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:26.475790 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e659cd43-4cba-4d80-893a-5f096c64e33a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.476219 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e659cd43-4cba-4d80-893a-5f096c64e33a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:26.491193 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:26.509663 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e659cd43-4cba-4d80-893a-5f096c64e33a tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047398 Jun 21 16:55:26.510233 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 385/747] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:55:26 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 16:55:26.572435 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c28cdc59-490c-4901-a187-b32db6795519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:26.573331 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c28cdc59-490c-4901-a187-b32db6795519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:26.580075 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c28cdc59-490c-4901-a187-b32db6795519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.580528 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c28cdc59-490c-4901-a187-b32db6795519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:26.581333 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c28cdc59-490c-4901-a187-b32db6795519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.581814 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c28cdc59-490c-4901-a187-b32db6795519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:26.610275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c28cdc59-490c-4901-a187-b32db6795519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Going to try to terminate instance {{(pid=124685) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:55:26.612427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4c61b0d9-2ac9-4a35-9d16-0f54b84a8bb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:26.619938 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4c61b0d9-2ac9-4a35-9d16-0f54b84a8bb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.166904 Jun 21 16:55:26.620507 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 363/748] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:26 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:26.988308 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f172628e-3baa-4ee7-b24e-540b9c35c67d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:26.988915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f172628e-3baa-4ee7-b24e-540b9c35c67d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:26.995268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f172628e-3baa-4ee7-b24e-540b9c35c67d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.995779 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f172628e-3baa-4ee7-b24e-540b9c35c67d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:26.996540 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f172628e-3baa-4ee7-b24e-540b9c35c67d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:26.996920 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f172628e-3baa-4ee7-b24e-540b9c35c67d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:27.013752 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c28cdc59-490c-4901-a187-b32db6795519 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "DELETE /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 204 len: 0 microversion: 2.1 time: 0.446394 Jun 21 16:55:27.014977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 386/749] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:55:26 2022] DELETE /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 16:55:27.024088 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7485d8e5-8d94-4529-b412-615e4ff3c011 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:27.024792 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7485d8e5-8d94-4529-b412-615e4ff3c011 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:27.032034 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7485d8e5-8d94-4529-b412-615e4ff3c011 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:27.032490 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7485d8e5-8d94-4529-b412-615e4ff3c011 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:27.033264 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7485d8e5-8d94-4529-b412-615e4ff3c011 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:27.033771 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7485d8e5-8d94-4529-b412-615e4ff3c011 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:27.142950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f172628e-3baa-4ee7-b24e-540b9c35c67d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:27.151388 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f172628e-3baa-4ee7-b24e-540b9c35c67d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.167520 Jun 21 16:55:27.151967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 364/750] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:26 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:27.178508 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7485d8e5-8d94-4529-b412-615e4ff3c011 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:27.185978 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7485d8e5-8d94-4529-b412-615e4ff3c011 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1673 microversion: 2.1 time: 0.166277 Jun 21 16:55:27.187151 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 387/751] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:27 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:27.637799 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3727f369-28ce-41fb-881b-7b4b83dfe12c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:27.638329 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3727f369-28ce-41fb-881b-7b4b83dfe12c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:27.644836 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3727f369-28ce-41fb-881b-7b4b83dfe12c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:27.645292 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3727f369-28ce-41fb-881b-7b4b83dfe12c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:27.646069 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3727f369-28ce-41fb-881b-7b4b83dfe12c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:27.646494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3727f369-28ce-41fb-881b-7b4b83dfe12c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:27.781760 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3727f369-28ce-41fb-881b-7b4b83dfe12c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:27.789368 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3727f369-28ce-41fb-881b-7b4b83dfe12c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.155425 Jun 21 16:55:27.789941 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 365/752] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:27 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:28.168270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-220ecb13-e7e8-44d0-bdbe-593a5e23593f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:28.168970 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-220ecb13-e7e8-44d0-bdbe-593a5e23593f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:28.172197 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:28.177548 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-220ecb13-e7e8-44d0-bdbe-593a5e23593f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:28.178036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-220ecb13-e7e8-44d0-bdbe-593a5e23593f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:28.178850 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-220ecb13-e7e8-44d0-bdbe-593a5e23593f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:28.179330 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-220ecb13-e7e8-44d0-bdbe-593a5e23593f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:28.206505 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-34459185-8ea9-4af8-acaa-d91de94d65a6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:28.207119 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-34459185-8ea9-4af8-acaa-d91de94d65a6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:28.213235 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-34459185-8ea9-4af8-acaa-d91de94d65a6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:28.213718 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-34459185-8ea9-4af8-acaa-d91de94d65a6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:28.214479 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-34459185-8ea9-4af8-acaa-d91de94d65a6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:28.214907 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-34459185-8ea9-4af8-acaa-d91de94d65a6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:28.323807 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-220ecb13-e7e8-44d0-bdbe-593a5e23593f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:28.334335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-220ecb13-e7e8-44d0-bdbe-593a5e23593f tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.169645 Jun 21 16:55:28.335567 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 388/753] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:28 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:28.359655 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-34459185-8ea9-4af8-acaa-d91de94d65a6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:28.368043 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-34459185-8ea9-4af8-acaa-d91de94d65a6 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1673 microversion: 2.1 time: 0.166630 Jun 21 16:55:28.368615 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 366/754] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:28 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:28.816242 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-acadd93a-2f00-4df7-ad38-44b02db51f30 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:28.816853 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-acadd93a-2f00-4df7-ad38-44b02db51f30 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:28.818740 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=8 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:28.823633 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acadd93a-2f00-4df7-ad38-44b02db51f30 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:28.824086 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acadd93a-2f00-4df7-ad38-44b02db51f30 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:28.824859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acadd93a-2f00-4df7-ad38-44b02db51f30 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:28.825313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acadd93a-2f00-4df7-ad38-44b02db51f30 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:28.967417 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-acadd93a-2f00-4df7-ad38-44b02db51f30 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:28.975133 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-acadd93a-2f00-4df7-ad38-44b02db51f30 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.162901 Jun 21 16:55:28.975709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 389/755] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:28 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:29.355064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-df0f410e-5859-4f00-b2d2-d6a913fa644b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:29.355787 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-df0f410e-5859-4f00-b2d2-d6a913fa644b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:29.363317 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-df0f410e-5859-4f00-b2d2-d6a913fa644b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:29.363765 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-df0f410e-5859-4f00-b2d2-d6a913fa644b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:29.364576 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-df0f410e-5859-4f00-b2d2-d6a913fa644b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:29.365009 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-df0f410e-5859-4f00-b2d2-d6a913fa644b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:29.386113 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6ad61053-6995-4956-9a41-5f8b9e5bbdf4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:29.386728 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6ad61053-6995-4956-9a41-5f8b9e5bbdf4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:29.397566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6ad61053-6995-4956-9a41-5f8b9e5bbdf4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:29.397566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6ad61053-6995-4956-9a41-5f8b9e5bbdf4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:29.397566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6ad61053-6995-4956-9a41-5f8b9e5bbdf4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:29.397566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6ad61053-6995-4956-9a41-5f8b9e5bbdf4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:29.544506 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6ad61053-6995-4956-9a41-5f8b9e5bbdf4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:29.552704 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6ad61053-6995-4956-9a41-5f8b9e5bbdf4 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1673 microversion: 2.1 time: 0.170370 Jun 21 16:55:29.553340 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 390/756] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:29 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:29.621235 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-df0f410e-5859-4f00-b2d2-d6a913fa644b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:29.629683 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-df0f410e-5859-4f00-b2d2-d6a913fa644b tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.278602 Jun 21 16:55:29.630266 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 367/757] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:29 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:29.993185 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bc1d71a9-8c96-458e-bcb3-7ad187b58df2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:29.993989 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-bc1d71a9-8c96-458e-bcb3-7ad187b58df2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:30.000962 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bc1d71a9-8c96-458e-bcb3-7ad187b58df2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:30.001446 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bc1d71a9-8c96-458e-bcb3-7ad187b58df2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:30.002220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bc1d71a9-8c96-458e-bcb3-7ad187b58df2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:30.002912 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bc1d71a9-8c96-458e-bcb3-7ad187b58df2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:30.154208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-bc1d71a9-8c96-458e-bcb3-7ad187b58df2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:30.162946 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-bc1d71a9-8c96-458e-bcb3-7ad187b58df2 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.173626 Jun 21 16:55:30.173410 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 391/758] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:29 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:30.174278 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-dbba5df1-5928-43d2-ba41-ef67b546219e req-a8101821-6d56-4392-a8e7-84b45036a823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ae4eba-c5bd-4271-8d4b-231ffc992e4d", "name": "network-vif-deleted", "tag": "be3f7f6a-58a7-460b-adf0-85a4608bba76"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:30.182607 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-dbba5df1-5928-43d2-ba41-ef67b546219e req-a8101821-6d56-4392-a8e7-84b45036a823 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:30.183051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-dbba5df1-5928-43d2-ba41-ef67b546219e req-a8101821-6d56-4392-a8e7-84b45036a823 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:30.196207 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-dbba5df1-5928-43d2-ba41-ef67b546219e req-a8101821-6d56-4392-a8e7-84b45036a823 service nova] Creating event network-vif-deleted:be3f7f6a-58a7-460b-adf0-85a4608bba76 for instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d on hv-cinder-79987 Jun 21 16:55:30.201228 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-dbba5df1-5928-43d2-ba41-ef67b546219e req-a8101821-6d56-4392-a8e7-84b45036a823 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031411 Jun 21 16:55:30.205732 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 368/759] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:30.570924 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a148f473-b938-4d42-9d1f-e31c3b965f88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:30.571534 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a148f473-b938-4d42-9d1f-e31c3b965f88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:30.579689 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a148f473-b938-4d42-9d1f-e31c3b965f88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:30.580172 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a148f473-b938-4d42-9d1f-e31c3b965f88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:30.581035 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a148f473-b938-4d42-9d1f-e31c3b965f88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:30.581493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a148f473-b938-4d42-9d1f-e31c3b965f88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:30.648377 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fc10bd76-0e33-4f56-ae25-1cd5469db6ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:30.649109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-fc10bd76-0e33-4f56-ae25-1cd5469db6ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:30.650685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a148f473-b938-4d42-9d1f-e31c3b965f88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:30.658599 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fc10bd76-0e33-4f56-ae25-1cd5469db6ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:30.659043 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fc10bd76-0e33-4f56-ae25-1cd5469db6ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:30.660163 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fc10bd76-0e33-4f56-ae25-1cd5469db6ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:30.660597 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fc10bd76-0e33-4f56-ae25-1cd5469db6ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:30.664401 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a148f473-b938-4d42-9d1f-e31c3b965f88 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1321 microversion: 2.1 time: 0.097293 Jun 21 16:55:30.665114 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 392/760] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:30 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1321 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:30.806860 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fc10bd76-0e33-4f56-ae25-1cd5469db6ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:30.815747 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fc10bd76-0e33-4f56-ae25-1cd5469db6ad tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.172255 Jun 21 16:55:30.816333 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 369/761] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:30 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:31.180138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3e7b7041-3c66-4a51-b425-5e766f891846 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:31.180690 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3e7b7041-3c66-4a51-b425-5e766f891846 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:31.187817 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e7b7041-3c66-4a51-b425-5e766f891846 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:31.188596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e7b7041-3c66-4a51-b425-5e766f891846 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:31.189950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e7b7041-3c66-4a51-b425-5e766f891846 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:31.190731 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3e7b7041-3c66-4a51-b425-5e766f891846 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:31.335661 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3e7b7041-3c66-4a51-b425-5e766f891846 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:31.343749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3e7b7041-3c66-4a51-b425-5e766f891846 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.167487 Jun 21 16:55:31.344335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 393/762] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:31 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:31.681503 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:31.682105 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:31.689512 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:31.689997 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:31.690791 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:31.691256 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:31.727314 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:31.727765 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:31.728197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lazy-loading 'fault' on Instance uuid 99ae4eba-c5bd-4271-8d4b-231ffc992e4d {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:55:31.773906 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ad18360dc64d2ea85cc950c9daa723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a35c2bcb0e44e0ab3751a83635424e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:31.782186 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bfe81a26-6585-4fed-9c18-9fca075549c8 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 200 len: 1326 microversion: 2.1 time: 0.104557 Jun 21 16:55:31.782825 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 370/763] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:31 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:31.832254 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4f4f41e9-9acc-40b3-89d3-d8447fc9df2a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:31.832855 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4f4f41e9-9acc-40b3-89d3-d8447fc9df2a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:31.839302 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4f4f41e9-9acc-40b3-89d3-d8447fc9df2a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:31.839750 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4f4f41e9-9acc-40b3-89d3-d8447fc9df2a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:31.840504 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4f4f41e9-9acc-40b3-89d3-d8447fc9df2a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:31.840936 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4f4f41e9-9acc-40b3-89d3-d8447fc9df2a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:31.985689 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4f4f41e9-9acc-40b3-89d3-d8447fc9df2a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:31.993452 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4f4f41e9-9acc-40b3-89d3-d8447fc9df2a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.164971 Jun 21 16:55:31.993990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 394/764] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:31 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:32.360872 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-92cdd71e-f365-445a-a3fe-8f6c2c45ed50 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:32.361569 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-92cdd71e-f365-445a-a3fe-8f6c2c45ed50 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:32.367728 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-92cdd71e-f365-445a-a3fe-8f6c2c45ed50 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:32.368153 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-92cdd71e-f365-445a-a3fe-8f6c2c45ed50 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:32.368923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-92cdd71e-f365-445a-a3fe-8f6c2c45ed50 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:32.369387 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-92cdd71e-f365-445a-a3fe-8f6c2c45ed50 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:32.510492 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-92cdd71e-f365-445a-a3fe-8f6c2c45ed50 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:32.518943 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-92cdd71e-f365-445a-a3fe-8f6c2c45ed50 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.162042 Jun 21 16:55:32.519464 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 371/765] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:32 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:32.800422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:32.800941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:32.807401 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:32.807899 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:32.808625 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:32.809054 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:32.824297 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] HTTP exception thrown: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Request method failure captured: Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d HTTP/1.1 Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZpV8W35e9XU2-fZVSYZl3vp-PX0Tkc4yTDs4toeioH_WmZVgU5lNMHmX5vQQOHwzWZeXXDSjNkcsa9PFrAjsgerhrRcOGDjncH3nXkjBwOIv9j0IpBY8EOcBXUvjkSvdCcvOEGJAbtxlfmtG28ymzQD8dC5EEKRP1WDLKJLKJ0KoY Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:55:32.826002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0a35c2bcb0e44e0ab3751a83635424e8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 52ad18360dc64d2ea85cc950c9daa723 Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:32.827553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '99ae4eba-c5bd-4271-8d4b-231ffc992e4d'} Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:55:32.828281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:32.829489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:32.830587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Returning 404 to user: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:55:32.830587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0cd48d7d-be7c-4811-bbcf-7ca0137a98d9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 404 len: 111 microversion: 2.1 time: 0.031685 Jun 21 16:55:32.830587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 395/766] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:32 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:55:32.836386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e74f05a4-86bf-4f5e-8487-cda70eff739d tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '.version_select at 0x7f0a429fc820>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:32.945886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e74f05a4-86bf-4f5e-8487-cda70eff739d tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-704292400" status: 202 len: 0 microversion: 2.1 time: 0.113243 Jun 21 16:55:32.946479 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 372/767] 10.222.0.70 () {58 vars in 1217 bytes} [Tue Jun 21 16:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-704292400 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:55:33.010943 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-05f2db64-09cc-4b5f-aca7-46b34f08b9e7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:33.011559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-05f2db64-09cc-4b5f-aca7-46b34f08b9e7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:33.018309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-05f2db64-09cc-4b5f-aca7-46b34f08b9e7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:33.018762 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-05f2db64-09cc-4b5f-aca7-46b34f08b9e7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:33.019575 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-05f2db64-09cc-4b5f-aca7-46b34f08b9e7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:33.020010 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-05f2db64-09cc-4b5f-aca7-46b34f08b9e7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:33.161374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-05f2db64-09cc-4b5f-aca7-46b34f08b9e7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:33.169913 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-05f2db64-09cc-4b5f-aca7-46b34f08b9e7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.162748 Jun 21 16:55:33.171222 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 396/768] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:33 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:33.537134 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-64f5b2ab-dec7-4d2b-9336-b4f37c5ce0d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:33.537783 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-64f5b2ab-dec7-4d2b-9336-b4f37c5ce0d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:33.543970 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-64f5b2ab-dec7-4d2b-9336-b4f37c5ce0d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:33.544423 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-64f5b2ab-dec7-4d2b-9336-b4f37c5ce0d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:33.545221 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-64f5b2ab-dec7-4d2b-9336-b4f37c5ce0d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:33.545905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-64f5b2ab-dec7-4d2b-9336-b4f37c5ce0d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:33.680655 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-64f5b2ab-dec7-4d2b-9336-b4f37c5ce0d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:33.688871 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-64f5b2ab-dec7-4d2b-9336-b4f37c5ce0d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.155734 Jun 21 16:55:33.689479 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 373/769] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:33 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:34.189615 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a34857d1-15f2-4399-951b-1a06cf57fb71 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:34.190502 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a34857d1-15f2-4399-951b-1a06cf57fb71 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:34.197465 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a34857d1-15f2-4399-951b-1a06cf57fb71 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:34.197908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a34857d1-15f2-4399-951b-1a06cf57fb71 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:34.198663 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a34857d1-15f2-4399-951b-1a06cf57fb71 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:34.199092 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a34857d1-15f2-4399-951b-1a06cf57fb71 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:34.351225 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a34857d1-15f2-4399-951b-1a06cf57fb71 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:34.359480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a34857d1-15f2-4399-951b-1a06cf57fb71 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.174877 Jun 21 16:55:34.360472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 397/770] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:34 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:34.705974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ae0472c0-04ff-47ad-b409-2b78e50a9aa5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:34.706601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ae0472c0-04ff-47ad-b409-2b78e50a9aa5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:34.711618 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-d8bdeddb-53d9-49ef-a485-b3235f7e2a1f req-318395d1-2df7-4125-92f4-599a62ba3673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdcabcd-b09e-4215-9fd3-914201278c7d", "name": "network-vif-plugged", "status": "completed", "tag": "b654ed50-66dd-4643-897e-9f5c0d189bff"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:34.715733 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae0472c0-04ff-47ad-b409-2b78e50a9aa5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:34.716190 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae0472c0-04ff-47ad-b409-2b78e50a9aa5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:34.716968 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae0472c0-04ff-47ad-b409-2b78e50a9aa5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:34.717967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae0472c0-04ff-47ad-b409-2b78e50a9aa5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:34.721518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-d8bdeddb-53d9-49ef-a485-b3235f7e2a1f req-318395d1-2df7-4125-92f4-599a62ba3673 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:34.722027 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-d8bdeddb-53d9-49ef-a485-b3235f7e2a1f req-318395d1-2df7-4125-92f4-599a62ba3673 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:34.734198 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-d8bdeddb-53d9-49ef-a485-b3235f7e2a1f req-318395d1-2df7-4125-92f4-599a62ba3673 service nova] Creating event network-vif-plugged:b654ed50-66dd-4643-897e-9f5c0d189bff for instance ebdcabcd-b09e-4215-9fd3-914201278c7d on hv-cinder-79987 Jun 21 16:55:34.739425 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-d8bdeddb-53d9-49ef-a485-b3235f7e2a1f req-318395d1-2df7-4125-92f4-599a62ba3673 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032208 Jun 21 16:55:34.742315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 398/771] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:34.859049 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ae0472c0-04ff-47ad-b409-2b78e50a9aa5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:34.866878 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ae0472c0-04ff-47ad-b409-2b78e50a9aa5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.164860 Jun 21 16:55:34.867445 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 374/772] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:34 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:35.377069 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-95bae920-6b67-4e72-a117-293afecd7e00 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:35.378080 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-95bae920-6b67-4e72-a117-293afecd7e00 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:35.384113 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-95bae920-6b67-4e72-a117-293afecd7e00 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:35.384562 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-95bae920-6b67-4e72-a117-293afecd7e00 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:35.385338 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-95bae920-6b67-4e72-a117-293afecd7e00 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:35.385773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-95bae920-6b67-4e72-a117-293afecd7e00 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:35.523130 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-95bae920-6b67-4e72-a117-293afecd7e00 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:35.531521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-95bae920-6b67-4e72-a117-293afecd7e00 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.159024 Jun 21 16:55:35.532089 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 399/773] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:35 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:35.885354 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c6ec71d0-ed6b-4a95-ac03-e487c44c73b0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:35.885960 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c6ec71d0-ed6b-4a95-ac03-e487c44c73b0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:35.892624 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c6ec71d0-ed6b-4a95-ac03-e487c44c73b0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:35.900325 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c6ec71d0-ed6b-4a95-ac03-e487c44c73b0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:35.900325 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c6ec71d0-ed6b-4a95-ac03-e487c44c73b0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:35.900325 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c6ec71d0-ed6b-4a95-ac03-e487c44c73b0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:36.037980 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c6ec71d0-ed6b-4a95-ac03-e487c44c73b0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:36.045399 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c6ec71d0-ed6b-4a95-ac03-e487c44c73b0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1265 microversion: 2.1 time: 0.164090 Jun 21 16:55:36.046457 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 375/774] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:35 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:36.356457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:36.356945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:36.363812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:36.364267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:36.369602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:36.369602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:36.381834 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] HTTP exception thrown: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Request method failure captured: Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: DELETE /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d HTTP/1.1 Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZpV8W35e9XU2-fZVSYZl3vp-PX0Tkc4yTDs4toeioH_WmZVgU5lNMHmX5vQQOHwzWZeXXDSjNkcsa9PFrAjsgerhrRcOGDjncH3nXkjBwOIv9j0IpBY8EOcBXUvjkSvdCcvOEGJAbtxlfmtG28ymzQD8dC5EEKRP1WDLKJLKJ0KoY Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:55:36.383497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0a35c2bcb0e44e0ab3751a83635424e8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 52ad18360dc64d2ea85cc950c9daa723 Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.385439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '99ae4eba-c5bd-4271-8d4b-231ffc992e4d'} Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:55:36.386472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.388275 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.389732 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Returning 404 to user: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:55:36.389732 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-30711d09-9e37-4d0a-94c8-309b639cc04c tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "DELETE /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 404 len: 111 microversion: 2.1 time: 0.032270 Jun 21 16:55:36.389732 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 400/775] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:55:36 2022] DELETE /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:55:36.394474 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:36.395085 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: 99ae4eba-c5bd-4271-8d4b-231ffc992e4d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:36.401080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:36.401744 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:36.402316 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:36.402839 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:36.418858 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] HTTP exception thrown: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Request method failure captured: Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d HTTP/1.1 Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZpV8W35e9XU2-fZVSYZl3vp-PX0Tkc4yTDs4toeioH_WmZVgU5lNMHmX5vQQOHwzWZeXXDSjNkcsa9PFrAjsgerhrRcOGDjncH3nXkjBwOIv9j0IpBY8EOcBXUvjkSvdCcvOEGJAbtxlfmtG28ymzQD8dC5EEKRP1WDLKJLKJ0KoY Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:55:36.420484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0a35c2bcb0e44e0ab3751a83635424e8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 52ad18360dc64d2ea85cc950c9daa723 Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.422500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '99ae4eba-c5bd-4271-8d4b-231ffc992e4d'} Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:55:36.423698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. Jun 21 16:55:36.425080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:36.426774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Returning 404 to user: Instance 99ae4eba-c5bd-4271-8d4b-231ffc992e4d could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:55:36.426774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-caaf8628-da53-4c6f-991f-e4a23f944a2b tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d" status: 404 len: 111 microversion: 2.1 time: 0.032537 Jun 21 16:55:36.426774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 376/776] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:36 2022] GET /compute/v2.1/servers/99ae4eba-c5bd-4271-8d4b-231ffc992e4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:55:36.547904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d00ce4c9-f712-4f6d-b56d-8a372ff69965 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:36.548512 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d00ce4c9-f712-4f6d-b56d-8a372ff69965 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:36.554834 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d00ce4c9-f712-4f6d-b56d-8a372ff69965 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:36.555291 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d00ce4c9-f712-4f6d-b56d-8a372ff69965 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:36.556048 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d00ce4c9-f712-4f6d-b56d-8a372ff69965 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:36.556488 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d00ce4c9-f712-4f6d-b56d-8a372ff69965 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:36.695409 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d00ce4c9-f712-4f6d-b56d-8a372ff69965 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:36.703116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d00ce4c9-f712-4f6d-b56d-8a372ff69965 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.159135 Jun 21 16:55:36.704437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 401/777] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:36 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:36.755041 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-e141b23b-b043-431c-afbc-4a2d698b96ea req-bafdb363-0a92-425a-95a7-9d455b24d935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c7a8e0-22b7-46fd-8a39-03e153ce2dc4", "name": "network-vif-plugged", "status": "completed", "tag": "abae0918-ee64-4a4d-89a7-fad9196b8160"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:36.763182 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-e141b23b-b043-431c-afbc-4a2d698b96ea req-bafdb363-0a92-425a-95a7-9d455b24d935 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:36.763911 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-e141b23b-b043-431c-afbc-4a2d698b96ea req-bafdb363-0a92-425a-95a7-9d455b24d935 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:36.776281 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-e141b23b-b043-431c-afbc-4a2d698b96ea req-bafdb363-0a92-425a-95a7-9d455b24d935 service nova] Creating event network-vif-plugged:abae0918-ee64-4a4d-89a7-fad9196b8160 for instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 on hv-cinder-79987 Jun 21 16:55:36.781334 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-e141b23b-b043-431c-afbc-4a2d698b96ea req-bafdb363-0a92-425a-95a7-9d455b24d935 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030112 Jun 21 16:55:36.782733 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 377/778] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:37.064111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a3f03f88-5644-4f00-ba50-c146161ccc86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:37.065177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a3f03f88-5644-4f00-ba50-c146161ccc86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:37.071064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a3f03f88-5644-4f00-ba50-c146161ccc86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.071528 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a3f03f88-5644-4f00-ba50-c146161ccc86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.072285 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a3f03f88-5644-4f00-ba50-c146161ccc86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.072719 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a3f03f88-5644-4f00-ba50-c146161ccc86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.089637 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:37.215563 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a3f03f88-5644-4f00-ba50-c146161ccc86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:37.223324 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a3f03f88-5644-4f00-ba50-c146161ccc86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1453 microversion: 2.1 time: 0.164111 Jun 21 16:55:37.223881 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 402/779] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:37 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:55:37.240530 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5cbc0555-7db3-4b11-b5df-ec1536196550 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:37.245084 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5cbc0555-7db3-4b11-b5df-ec1536196550 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:37.247967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5cbc0555-7db3-4b11-b5df-ec1536196550 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.248501 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5cbc0555-7db3-4b11-b5df-ec1536196550 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.249253 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5cbc0555-7db3-4b11-b5df-ec1536196550 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.249708 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5cbc0555-7db3-4b11-b5df-ec1536196550 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.397235 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-5cbc0555-7db3-4b11-b5df-ec1536196550 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:37.399837 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:37.405707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5cbc0555-7db3-4b11-b5df-ec1536196550 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1453 microversion: 2.1 time: 0.169693 Jun 21 16:55:37.406269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 378/780] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:37 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:37.721340 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fbb92c06-b705-4128-9f16-3961a4399021 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:37.722886 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fbb92c06-b705-4128-9f16-3961a4399021 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:37.730951 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fbb92c06-b705-4128-9f16-3961a4399021 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.731400 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fbb92c06-b705-4128-9f16-3961a4399021 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.732176 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fbb92c06-b705-4128-9f16-3961a4399021 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.732612 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fbb92c06-b705-4128-9f16-3961a4399021 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.897091 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:37.898811 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:37.905744 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.906189 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.908236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.908764 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.924240 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] HTTP exception thrown: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Request method failure captured: Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: DELETE /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 HTTP/1.1 Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZpV8W35e9XU2-fZVSYZl3vp-PX0Tkc4yTDs4toeioH_WmZVgU5lNMHmX5vQQOHwzWZeXXDSjNkcsa9PFrAjsgerhrRcOGDjncH3nXkjBwOIv9j0IpBY8EOcBXUvjkSvdCcvOEGJAbtxlfmtG28ymzQD8dC5EEKRP1WDLKJLKJ0KoY Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:55:37.926417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0a35c2bcb0e44e0ab3751a83635424e8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 52ad18360dc64d2ea85cc950c9daa723 Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.927772 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': 'f605003b-48fd-4e3f-9f19-462e7b713558'} Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:55:37.928601 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.934115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.935394 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Returning 404 to user: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:55:37.935394 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-174f21d7-9500-4556-b47a-0694d32819b9 tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 404 len: 111 microversion: 2.1 time: 0.036479 Jun 21 16:55:37.935394 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 379/781] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:55:37 2022] DELETE /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 16:55:37.937196 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:37.938489 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] [instance: f605003b-48fd-4e3f-9f19-462e7b713558] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:37.944634 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.945090 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.945934 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:37.946367 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:37.962774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] HTTP exception thrown: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Request method failure captured: Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 HTTP/1.1 Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZpV8W35e9XU2-fZVSYZl3vp-PX0Tkc4yTDs4toeioH_WmZVgU5lNMHmX5vQQOHwzWZeXXDSjNkcsa9PFrAjsgerhrRcOGDjncH3nXkjBwOIv9j0IpBY8EOcBXUvjkSvdCcvOEGJAbtxlfmtG28ymzQD8dC5EEKRP1WDLKJLKJ0KoY Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:55:37.964418 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a35c2bcb0e44e0ab3751a83635424e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0a35c2bcb0e44e0ab3751a83635424e8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 0a35c2bcb0e44e0ab3751a83635424e8 Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1248601810 Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 52ad18360dc64d2ea85cc950c9daa723 Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeTestJSON-1248601810-project Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.966052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': 'f605003b-48fd-4e3f-9f19-462e7b713558'} Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:55:37.966899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. Jun 21 16:55:37.968141 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:55:37.969986 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] Returning 404 to user: Instance f605003b-48fd-4e3f-9f19-462e7b713558 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:55:37.969986 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d5b26f45-602a-4aeb-ba3f-440f48437a3f tempest-AttachVolumeTestJSON-1248601810 tempest-AttachVolumeTestJSON-1248601810-project] 10.222.0.70 "GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558" status: 404 len: 111 microversion: 2.1 time: 0.032872 Jun 21 16:55:37.969986 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 380/782] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:37 2022] GET /compute/v2.1/servers/f605003b-48fd-4e3f-9f19-462e7b713558 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:55:38.212315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fbb92c06-b705-4128-9f16-3961a4399021 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:38.221174 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fbb92c06-b705-4128-9f16-3961a4399021 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.504968 Jun 21 16:55:38.222139 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 403/783] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:37 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:39.238961 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c57c866b-be45-45de-b137-42377f2e7e94 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:39.240475 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c57c866b-be45-45de-b137-42377f2e7e94 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:39.247672 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c57c866b-be45-45de-b137-42377f2e7e94 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:39.248122 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c57c866b-be45-45de-b137-42377f2e7e94 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:39.248889 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c57c866b-be45-45de-b137-42377f2e7e94 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:39.249386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c57c866b-be45-45de-b137-42377f2e7e94 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:39.752451 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c57c866b-be45-45de-b137-42377f2e7e94 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:39.761632 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c57c866b-be45-45de-b137-42377f2e7e94 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1573 microversion: 2.1 time: 0.527128 Jun 21 16:55:39.764831 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 381/784] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:39 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1573 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:39.940315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-481fa6e7-0821-4c7c-9143-ff4a468bec52 req-0711cfb4-f9ed-4b98-97d9-cc35dd90be9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdcabcd-b09e-4215-9fd3-914201278c7d", "tag": "b654ed50-66dd-4643-897e-9f5c0d189bff"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:39.949304 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-481fa6e7-0821-4c7c-9143-ff4a468bec52 req-0711cfb4-f9ed-4b98-97d9-cc35dd90be9f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:39.949761 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-481fa6e7-0821-4c7c-9143-ff4a468bec52 req-0711cfb4-f9ed-4b98-97d9-cc35dd90be9f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:39.962692 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-481fa6e7-0821-4c7c-9143-ff4a468bec52 req-0711cfb4-f9ed-4b98-97d9-cc35dd90be9f service nova] Creating event network-changed:b654ed50-66dd-4643-897e-9f5c0d189bff for instance ebdcabcd-b09e-4215-9fd3-914201278c7d on hv-cinder-79987 Jun 21 16:55:39.968517 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-481fa6e7-0821-4c7c-9143-ff4a468bec52 req-0711cfb4-f9ed-4b98-97d9-cc35dd90be9f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097867 Jun 21 16:55:39.969321 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 404/785] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:40.787080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f2d5062f-12a1-4dad-b315-2ff24900dbd9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:40.788582 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f2d5062f-12a1-4dad-b315-2ff24900dbd9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:40.799268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2d5062f-12a1-4dad-b315-2ff24900dbd9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:40.800081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2d5062f-12a1-4dad-b315-2ff24900dbd9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:40.800933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2d5062f-12a1-4dad-b315-2ff24900dbd9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:40.801805 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f2d5062f-12a1-4dad-b315-2ff24900dbd9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:40.981378 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f2d5062f-12a1-4dad-b315-2ff24900dbd9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:40.989789 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f2d5062f-12a1-4dad-b315-2ff24900dbd9 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1560 microversion: 2.1 time: 0.214081 Jun 21 16:55:40.990292 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 382/786] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:55:40 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:53.774157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1502dc95-15c8-41f8-b18a-00159bfb773a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:53.774743 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1502dc95-15c8-41f8-b18a-00159bfb773a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:53.777466 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:53.778145 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=11 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:53.783073 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1502dc95-15c8-41f8-b18a-00159bfb773a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:53.783521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1502dc95-15c8-41f8-b18a-00159bfb773a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:53.784311 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1502dc95-15c8-41f8-b18a-00159bfb773a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:53.784710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1502dc95-15c8-41f8-b18a-00159bfb773a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:53.808326 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1502dc95-15c8-41f8-b18a-00159bfb773a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/ips" status: 200 len: 151 microversion: 2.1 time: 0.038435 Jun 21 16:55:53.808897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 405/787] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:55:53 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:55.616778 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1ff83b68-b14b-491b-b8c5-310b456a057a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:55.617731 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1ff83b68-b14b-491b-b8c5-310b456a057a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:55.621023 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:55.621717 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=17 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:55:55.629581 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff83b68-b14b-491b-b8c5-310b456a057a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:55.630028 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff83b68-b14b-491b-b8c5-310b456a057a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:55.630822 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff83b68-b14b-491b-b8c5-310b456a057a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:55.631250 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1ff83b68-b14b-491b-b8c5-310b456a057a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:55.659572 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1ff83b68-b14b-491b-b8c5-310b456a057a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048886 Jun 21 16:55:55.660736 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 383/788] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jun 21 16:55:55 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:55:55.719714 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6ee10398-b4ee-4a17-a721-3796e838b763 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:55.720326 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6ee10398-b4ee-4a17-a721-3796e838b763 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:55.727976 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6ee10398-b4ee-4a17-a721-3796e838b763 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:55.728435 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6ee10398-b4ee-4a17-a721-3796e838b763 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:55.729209 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6ee10398-b4ee-4a17-a721-3796e838b763 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:55.729724 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6ee10398-b4ee-4a17-a721-3796e838b763 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:55.755318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6ee10398-b4ee-4a17-a721-3796e838b763 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Going to try to terminate instance {{(pid=124685) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:55:55.991163 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-756f12be-8425-4a19-8e86-4c4b35e77a0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1034dd9c-ebe2-4210-aea5-148ab2e5af3f"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:55.992671 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-756f12be-8425-4a19-8e86-4c4b35e77a0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:56.001031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-756f12be-8425-4a19-8e86-4c4b35e77a0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:56.001507 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-756f12be-8425-4a19-8e86-4c4b35e77a0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:56.002297 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-756f12be-8425-4a19-8e86-4c4b35e77a0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:56.002728 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-756f12be-8425-4a19-8e86-4c4b35e77a0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:56.074567 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6ee10398-b4ee-4a17-a721-3796e838b763 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 204 len: 0 microversion: 2.20 time: 0.358968 Jun 21 16:55:56.075142 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 406/789] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jun 21 16:55:55 2022] DELETE /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 16:55:56.084681 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:56.085391 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:56.091335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:56.091773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:56.092532 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:56.092956 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:56.227781 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:56.236076 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:56.237865 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:56.239607 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7d65bb82-b94e-4784-9d75-2d015f3a170a tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.160121 Jun 21 16:55:56.242879 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 407/790] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:56 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:55:57.259027 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:57.259699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:57.265985 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:57.266456 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:57.267267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:57.267699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:57.418842 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:57.431964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:57.433828 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:57.435007 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c5264d6f-34c8-4d82-9cf6-b2b7df9d4be4 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.180092 Jun 21 16:55:57.435558 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 408/791] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:57 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 16:55:58.332386 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-756f12be-8425-4a19-8e86-4c4b35e77a0f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.345258 Jun 21 16:55:58.344871 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 384/792] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:55:55 2022] POST /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments => generated 194 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:58.455893 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:58.456651 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:58.463149 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:58.463596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:58.464363 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:58.464801 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:58.656024 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:58.668451 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:58.669997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:58.671850 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0a9b9305-c3af-485c-8e26-3f4c1e6e51d0 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1724 microversion: 2.20 time: 0.219216 Jun 21 16:55:58.683260 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 409/793] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:58 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:55:58.899415 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-90555455-0786-496f-bb16-53da5af472a8 req-06f9fb06-de1a-4e50-80a7-4bfb46a5f034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a46d00d-8f66-43bf-990b-e31ab81b9ae0", "name": "network-vif-deleted", "tag": "9422fb6f-a2be-40f8-9c46-eb984da56a96"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:55:58.908211 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-90555455-0786-496f-bb16-53da5af472a8 req-06f9fb06-de1a-4e50-80a7-4bfb46a5f034 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:58.908737 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-90555455-0786-496f-bb16-53da5af472a8 req-06f9fb06-de1a-4e50-80a7-4bfb46a5f034 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:58.920170 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-90555455-0786-496f-bb16-53da5af472a8 req-06f9fb06-de1a-4e50-80a7-4bfb46a5f034 service nova] Creating event network-vif-deleted:9422fb6f-a2be-40f8-9c46-eb984da56a96 for instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 on hv-cinder-79987 Jun 21 16:55:58.926199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-90555455-0786-496f-bb16-53da5af472a8 req-06f9fb06-de1a-4e50-80a7-4bfb46a5f034 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030523 Jun 21 16:55:58.926838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 385/794] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:55:59.697243 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:55:59.697243 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:55:59.703553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:59.704190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:59.705127 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:59.706264 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:59.748594 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:55:59.754465 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:55:59.754465 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lazy-loading 'fault' on Instance uuid 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:55:59.804762 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:59.808042 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:59.809885 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a25a52e592a34cd48a8c88304501c047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cd0d0402244286b9199e77f8ef18ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:55:59.811257 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-704cc33b-a49f-4209-bff1-328d99fcac5f tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 200 len: 1372 microversion: 2.20 time: 0.123938 Jun 21 16:55:59.811840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 410/795] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:55:59 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 16:56:00.830639 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:00.831424 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:00.838369 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:00.838817 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:00.839640 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:00.840065 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:00.854557 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] HTTP exception thrown: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Request method failure captured: Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 HTTP/1.1 Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZoo8geCpQCOPxdA1NwCVLYpOf8L8zNo6xPB2FCi3E4WgEGKj9OFYT0K1skwIv0nf46OpevxD4xxg_MuNbosCgyfNH0OlvhllmEUBF5OtccnI5vPvjdLgVAgFpm75lkUX2B2Fynuz_ck2oP3HaoZKL1xm0ufsksS8tihXhsyo3puRg Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:56:00.856214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cd0d0402244286b9199e77f8ef18ca", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: a25a52e592a34cd48a8c88304501c047 Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:00.858016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '4a46d00d-8f66-43bf-990b-e31ab81b9ae0'} Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:00.862797 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:00.864847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:00.866256 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Returning 404 to user: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:00.866256 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-23fff65b-7f30-4709-b07c-b2d193f7b090 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 404 len: 111 microversion: 2.20 time: 0.031778 Jun 21 16:56:00.866256 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 386/796] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:56:00 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:56:00.868017 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-de7a7018-6cb4-4ce1-aefd-2f0364419601 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '.version_select at 0x7f0a4298a790>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:00.968926 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-de7a7018-6cb4-4ce1-aefd-2f0364419601 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615291646" status: 204 len: 0 microversion: 2.20 time: 0.106096 Jun 21 16:56:00.969546 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 411/797] 10.222.0.70 () {60 vars in 1261 bytes} [Tue Jun 21 16:56:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615291646 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 21 16:56:03.521828 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:03.522330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:03.528628 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:03.529071 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:03.529907 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:03.530315 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:03.543919 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] HTTP exception thrown: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Request method failure captured: Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: DELETE /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 HTTP/1.1 Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZoo8geCpQCOPxdA1NwCVLYpOf8L8zNo6xPB2FCi3E4WgEGKj9OFYT0K1skwIv0nf46OpevxD4xxg_MuNbosCgyfNH0OlvhllmEUBF5OtccnI5vPvjdLgVAgFpm75lkUX2B2Fynuz_ck2oP3HaoZKL1xm0ufsksS8tihXhsyo3puRg Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:56:03.545469 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cd0d0402244286b9199e77f8ef18ca", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: a25a52e592a34cd48a8c88304501c047 Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.547128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '4a46d00d-8f66-43bf-990b-e31ab81b9ae0'} Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:03.547933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.560067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.561571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Returning 404 to user: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:03.561571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-7e40fb53-a72b-43f3-84bd-f4cd00f7e8f1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 404 len: 111 microversion: 2.20 time: 0.029467 Jun 21 16:56:03.561571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 387/798] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jun 21 16:56:03 2022] DELETE /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:56:03.561870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:03.561870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 4a46d00d-8f66-43bf-990b-e31ab81b9ae0] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:03.563893 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:03.564339 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:03.565247 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:03.565709 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:03.579919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] HTTP exception thrown: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Request method failure captured: Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 HTTP/1.1 Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZoo8geCpQCOPxdA1NwCVLYpOf8L8zNo6xPB2FCi3E4WgEGKj9OFYT0K1skwIv0nf46OpevxD4xxg_MuNbosCgyfNH0OlvhllmEUBF5OtccnI5vPvjdLgVAgFpm75lkUX2B2Fynuz_ck2oP3HaoZKL1xm0ufsksS8tihXhsyo3puRg Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:56:03.581595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cd0d0402244286b9199e77f8ef18ca", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: a25a52e592a34cd48a8c88304501c047 Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.583248 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '4a46d00d-8f66-43bf-990b-e31ab81b9ae0'} Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:03.584182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. Jun 21 16:56:03.585499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:03.586975 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Returning 404 to user: Instance 4a46d00d-8f66-43bf-990b-e31ab81b9ae0 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:03.586975 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1c81e9a9-f007-43ba-b00b-fe34b6badc03 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0" status: 404 len: 111 microversion: 2.20 time: 0.031482 Jun 21 16:56:03.586975 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 412/799] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:56:03 2022] GET /compute/v2.1/servers/4a46d00d-8f66-43bf-990b-e31ab81b9ae0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:56:04.958200 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:04.958767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:04.968103 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:04.968711 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:04.969790 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:04.970377 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:04.997775 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] HTTP exception thrown: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Request method failure captured: Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: DELETE /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 HTTP/1.1 Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfZoo8geCpQCOPxdA1NwCVLYpOf8L8zNo6xPB2FCi3E4WgEGKj9OFYT0K1skwIv0nf46OpevxD4xxg_MuNbosCgyfNH0OlvhllmEUBF5OtccnI5vPvjdLgVAgFpm75lkUX2B2Fynuz_ck2oP3HaoZKL1xm0ufsksS8tihXhsyo3puRg Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:56:04.999748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cd0d0402244286b9199e77f8ef18ca", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: a25a52e592a34cd48a8c88304501c047 Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:05.001296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '0d9af742-a7f3-4113-8ace-571502dad309'} Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:05.009081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:05.010463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.011744 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Returning 404 to user: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:05.011744 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-646d187f-512c-4911-98a2-366007e4dbb1 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 404 len: 111 microversion: 2.20 time: 0.047267 Jun 21 16:56:05.011744 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 388/800] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jun 21 16:56:04 2022] DELETE /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:56:05.014729 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:05.015331 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] [instance: 0d9af742-a7f3-4113-8ace-571502dad309] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:05.022780 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:05.023228 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:05.024002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:05.024432 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:05.038574 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] HTTP exception thrown: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Request method failure captured: Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 HTTP/1.1 Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfZoo8geCpQCOPxdA1NwCVLYpOf8L8zNo6xPB2FCi3E4WgEGKj9OFYT0K1skwIv0nf46OpevxD4xxg_MuNbosCgyfNH0OlvhllmEUBF5OtccnI5vPvjdLgVAgFpm75lkUX2B2Fynuz_ck2oP3HaoZKL1xm0ufsksS8tihXhsyo3puRg Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:56:05.040165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cd0d0402244286b9199e77f8ef18ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cd0d0402244286b9199e77f8ef18ca", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 85cd0d0402244286b9199e77f8ef18ca Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-135015479 Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: a25a52e592a34cd48a8c88304501c047 Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeShelveTestJSON-135015479-project Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:05.042581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '0d9af742-a7f3-4113-8ace-571502dad309'} Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:05.043492 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. Jun 21 16:56:05.044859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:05.046138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] Returning 404 to user: Instance 0d9af742-a7f3-4113-8ace-571502dad309 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:05.046138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9ad9c3bd-1ff2-4f2b-b7cd-dde3dfe97d35 tempest-AttachVolumeShelveTestJSON-135015479 tempest-AttachVolumeShelveTestJSON-135015479-project] 10.222.0.70 "GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309" status: 404 len: 111 microversion: 2.20 time: 0.030605 Jun 21 16:56:05.046138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 413/801] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jun 21 16:56:05 2022] GET /compute/v2.1/servers/0d9af742-a7f3-4113-8ace-571502dad309 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:56:07.030250 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f4e3f869-fc70-485b-9450-9794aeeb570f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: .version_select at 0x7f0a42abe4c0>, body: {"keypair": {"name": "tempest-keypair-190833479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp3MQA+xVlAMlQjrAcse//rh1XqtKqfVKAIcMIT80B74IeBYyU5G6Z4KLlH8pnmNiN+p1kHbXE5QPLix6XLUFtIrSsimRrOCAubrN1Cm0ZP2khgvh4t63JKnUSAuZvy6A=="}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:07.048461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-f4e3f869-fc70-485b-9450-9794aeeb570f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:56:07.054375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-f4e3f869-fc70-485b-9450-9794aeeb570f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for user 8d1c7f32f0624210ae0ba52c022fea5a and project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:56:07.144436 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f4e3f869-fc70-485b-9450-9794aeeb570f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117892 Jun 21 16:56:07.150863 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 389/802] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 16:56:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:10.261143 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-326247530", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83741c3b-7ff0-4b33-b398-e82b72fea3bd"}], "security_groups": [{"name": "tempest-securitygroup--1229326740"}], "key_name": "tempest-keypair-190833479", "user_data": "}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:10.369333 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] validate_networks() for [('83741c3b-7ff0-4b33-b398-e82b72fea3bd', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:56:10.804431 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:56:10.804944 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:56:10.805447 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:56:10.805854 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:56:10.806262 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:56:10.822373 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:10.822806 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:10.825457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:10.825457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:10.845836 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:56:10.850919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for user 8d1c7f32f0624210ae0ba52c022fea5a and project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:56:10.862823 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:56:10.866296 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:56:11.074676 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f4585272-b595-4162-bcbc-c55ccc0c71fe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.817822 Jun 21 16:56:11.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 414/803] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:56:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:56:11.087864 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7bc92891-554d-4ca8-85d5-47d6c2326702 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:11.088481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-7bc92891-554d-4ca8-85d5-47d6c2326702 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:11.173445 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-7bc92891-554d-4ca8-85d5-47d6c2326702 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:11.182325 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-7bc92891-554d-4ca8-85d5-47d6c2326702 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1240 microversion: 2.1 time: 0.099551 Jun 21 16:56:11.183007 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 390/804] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:11 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:11.639397 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bfb00885-3b4a-4900-bb21-df08c16cd3e0 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Action: 'create', calling method: .version_select at 0x7f0a436d4c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1006567311"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:12.201226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cbb4133a-f2b9-4025-b954-23c9e18d452f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:12.201878 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cbb4133a-f2b9-4025-b954-23c9e18d452f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:12.208857 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbb4133a-f2b9-4025-b954-23c9e18d452f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:12.209336 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbb4133a-f2b9-4025-b954-23c9e18d452f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:12.210117 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbb4133a-f2b9-4025-b954-23c9e18d452f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:12.210554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cbb4133a-f2b9-4025-b954-23c9e18d452f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:12.275812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cbb4133a-f2b9-4025-b954-23c9e18d452f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:12.284470 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cbb4133a-f2b9-4025-b954-23c9e18d452f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1244 microversion: 2.1 time: 0.088148 Jun 21 16:56:12.288232 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 391/805] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:12 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:56:12.447986 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-bfb00885-3b4a-4900-bb21-df08c16cd3e0 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.934787 Jun 21 16:56:12.448611 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 415/806] 10.222.0.70 () {60 vars in 1154 bytes} [Tue Jun 21 16:56:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 936 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 16:56:12.461952 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-68952a9a-d607-46ec-b1c3-1c3ca4e5c7f7 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a42a3a700>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:12.516649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-68952a9a-d607-46ec-b1c3-1c3ca4e5c7f7 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d" status: 200 len: 345 microversion: 2.1 time: 0.060760 Jun 21 16:56:12.518178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 392/807] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:56:12 2022] GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:13.307804 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-10b0c706-7dd4-44da-9af8-2698b92c47a9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:13.307804 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-10b0c706-7dd4-44da-9af8-2698b92c47a9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:13.312754 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-10b0c706-7dd4-44da-9af8-2698b92c47a9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:13.313203 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-10b0c706-7dd4-44da-9af8-2698b92c47a9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:13.314147 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-10b0c706-7dd4-44da-9af8-2698b92c47a9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:13.314596 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-10b0c706-7dd4-44da-9af8-2698b92c47a9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:13.380034 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-10b0c706-7dd4-44da-9af8-2698b92c47a9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:13.387942 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-10b0c706-7dd4-44da-9af8-2698b92c47a9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1300 microversion: 2.1 time: 0.089621 Jun 21 16:56:13.388981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 416/808] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:13 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:13.531222 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-72985187-6c8f-45db-a961-a51baffc9699 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a42a920d0>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:13.586384 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-72985187-6c8f-45db-a961-a51baffc9699 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d" status: 200 len: 346 microversion: 2.1 time: 0.059623 Jun 21 16:56:13.591022 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 393/809] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:56:13 2022] GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:13.599373 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-28915104-caba-406f-beb1-284e5281773a tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Action: 'create', calling method: .version_select at 0x7f0a42b419d0>, body: {"snapshot": {"volume_id": "50bad1bd-7868-4b04-bdfa-4890b5b8333d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-986724871"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:14.043928 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-28915104-caba-406f-beb1-284e5281773a tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.449452 Jun 21 16:56:14.049946 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 417/810] 10.222.0.70 () {60 vars in 1161 bytes} [Tue Jun 21 16:56:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:56:14.055706 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-38deba9c-28e8-4ba3-a975-6097fdb1d854 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a42abec10>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:14.092726 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-38deba9c-28e8-4ba3-a975-6097fdb1d854 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08" status: 200 len: 286 microversion: 2.1 time: 0.038397 Jun 21 16:56:14.092726 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 394/811] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 16:56:14 2022] GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:56:14.102331 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ff7fbdf0-9d73-40ff-abc0-b70ebffaffcf tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a4299a310>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:14.148156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ff7fbdf0-9d73-40ff-abc0-b70ebffaffcf tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.047576 Jun 21 16:56:14.149494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 418/812] 10.222.0.70 () {58 vars in 1139 bytes} [Tue Jun 21 16:56:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:14.161095 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cd0fc3f2-2313-4aea-8240-511310d111b0 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a42b95a60>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:14.210563 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cd0fc3f2-2313-4aea-8240-511310d111b0 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08" status: 200 len: 286 microversion: 2.1 time: 0.054272 Jun 21 16:56:14.211729 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 395/813] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 16:56:14 2022] GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:56:14.407504 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b459182a-6863-46f5-942a-c7d1d28b02ae tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:14.408121 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b459182a-6863-46f5-942a-c7d1d28b02ae tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:14.417766 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b459182a-6863-46f5-942a-c7d1d28b02ae tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:14.418222 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b459182a-6863-46f5-942a-c7d1d28b02ae tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:14.419002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b459182a-6863-46f5-942a-c7d1d28b02ae tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:14.419442 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b459182a-6863-46f5-942a-c7d1d28b02ae tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:14.566832 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b459182a-6863-46f5-942a-c7d1d28b02ae tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:14.574629 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b459182a-6863-46f5-942a-c7d1d28b02ae tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1366 microversion: 2.1 time: 0.171644 Jun 21 16:56:14.575210 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 419/814] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:14 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:15.182177 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-9e6d259a-f305-4bf9-ba1a-c695f4af1152 req-61d972dc-7eda-4e2f-8889-6114614fef04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e0967ec-4512-4953-8d0c-cd5c2616341c", "tag": "7cb6c36c-9757-4544-9b68-2781176ab5c4"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:15.194218 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-9e6d259a-f305-4bf9-ba1a-c695f4af1152 req-61d972dc-7eda-4e2f-8889-6114614fef04 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:15.194666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-9e6d259a-f305-4bf9-ba1a-c695f4af1152 req-61d972dc-7eda-4e2f-8889-6114614fef04 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:15.207770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-9e6d259a-f305-4bf9-ba1a-c695f4af1152 req-61d972dc-7eda-4e2f-8889-6114614fef04 service nova] Creating event network-changed:7cb6c36c-9757-4544-9b68-2781176ab5c4 for instance 5e0967ec-4512-4953-8d0c-cd5c2616341c on hv-cinder-79987 Jun 21 16:56:15.213596 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-9e6d259a-f305-4bf9-ba1a-c695f4af1152 req-61d972dc-7eda-4e2f-8889-6114614fef04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038243 Jun 21 16:56:15.214368 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 396/815] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:15.222435 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f1a9f18a-c6bf-4a9e-9f39-15f8cb072a38 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a42b419d0>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:15.255154 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f1a9f18a-c6bf-4a9e-9f39-15f8cb072a38 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08" status: 200 len: 286 microversion: 2.1 time: 0.035326 Jun 21 16:56:15.255911 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 420/816] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 16:56:15 2022] GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:56:15.592550 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b44890ff-4d5d-42ff-bb05-7a8bc63c6bdd tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:15.593357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b44890ff-4d5d-42ff-bb05-7a8bc63c6bdd tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:15.599673 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b44890ff-4d5d-42ff-bb05-7a8bc63c6bdd tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:15.600122 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b44890ff-4d5d-42ff-bb05-7a8bc63c6bdd tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:15.600882 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b44890ff-4d5d-42ff-bb05-7a8bc63c6bdd tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:15.601360 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b44890ff-4d5d-42ff-bb05-7a8bc63c6bdd tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:15.732109 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b44890ff-4d5d-42ff-bb05-7a8bc63c6bdd tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:15.740218 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b44890ff-4d5d-42ff-bb05-7a8bc63c6bdd tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1366 microversion: 2.1 time: 0.151954 Jun 21 16:56:15.740775 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 397/817] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:15 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:16.267557 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e6d44648-6761-4a7c-93ab-46787f4465ea tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a4297e5e0>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:16.297724 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e6d44648-6761-4a7c-93ab-46787f4465ea tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08" status: 200 len: 286 microversion: 2.1 time: 0.034389 Jun 21 16:56:16.298286 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 421/818] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 16:56:16 2022] GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:16.757407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c0eeca81-0c55-4d82-abbf-e58e02e21a4b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:16.758020 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c0eeca81-0c55-4d82-abbf-e58e02e21a4b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:16.764626 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c0eeca81-0c55-4d82-abbf-e58e02e21a4b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:16.765062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c0eeca81-0c55-4d82-abbf-e58e02e21a4b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:16.765849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c0eeca81-0c55-4d82-abbf-e58e02e21a4b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:16.766272 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c0eeca81-0c55-4d82-abbf-e58e02e21a4b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:16.900219 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c0eeca81-0c55-4d82-abbf-e58e02e21a4b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:16.907652 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c0eeca81-0c55-4d82-abbf-e58e02e21a4b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1366 microversion: 2.1 time: 0.154670 Jun 21 16:56:16.908146 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 398/819] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:16 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:17.314185 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6fd4b9a2-6417-45d1-aff2-a705b4fe1d89 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a42aa7940>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:17.344352 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6fd4b9a2-6417-45d1-aff2-a705b4fe1d89 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08" status: 200 len: 286 microversion: 2.1 time: 0.037613 Jun 21 16:56:17.345129 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 422/820] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 16:56:17 2022] GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:17.924284 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1a3e3648-e6f8-458a-a593-4b5735ab2fe2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:17.924893 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1a3e3648-e6f8-458a-a593-4b5735ab2fe2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:17.932035 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a3e3648-e6f8-458a-a593-4b5735ab2fe2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:17.932487 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a3e3648-e6f8-458a-a593-4b5735ab2fe2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:17.933255 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a3e3648-e6f8-458a-a593-4b5735ab2fe2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:17.933721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1a3e3648-e6f8-458a-a593-4b5735ab2fe2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:18.077594 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1a3e3648-e6f8-458a-a593-4b5735ab2fe2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:18.085708 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1a3e3648-e6f8-458a-a593-4b5735ab2fe2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1366 microversion: 2.1 time: 0.165393 Jun 21 16:56:18.089432 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 399/821] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:17 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:18.338440 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1835341452", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:18.356074 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f83ea368-15d7-47cf-bb18-c918c7b29ab9 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a42abe9d0>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:18.390201 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f83ea368-15d7-47cf-bb18-c918c7b29ab9 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08" status: 200 len: 287 microversion: 2.1 time: 0.037996 Jun 21 16:56:18.392417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 400/822] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 16:56:18 2022] GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:56:18.392566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] validate_networks() for None {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:56:18.400960 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-00dc0da5-2dbe-402e-a003-ab202f770d53 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a42a253a0>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:18.529082 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-00dc0da5-2dbe-402e-a003-ab202f770d53 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08" status: 202 len: 0 microversion: 2.1 time: 0.131779 Jun 21 16:56:18.529715 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 401/823] 10.222.0.70 () {58 vars in 1253 bytes} [Tue Jun 21 16:56:18 2022] DELETE /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 16:56:18.538072 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6ae3da1f-88a3-47a9-81d8-46f61805a141 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a4b37fd30>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:18.571857 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6ae3da1f-88a3-47a9-81d8-46f61805a141 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08" status: 200 len: 286 microversion: 2.1 time: 0.037712 Jun 21 16:56:18.572432 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 402/824] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 16:56:18 2022] GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:56:18.903602 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:56:18.904079 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:56:18.904497 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:56:18.904907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:56:18.905346 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:56:18.914931 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:18.915373 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:18.916166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:18.916601 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:18.934010 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Getting quotas for project c7bfc0bf30a64c10ac10270fa96ef591. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:56:18.937784 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Getting quotas for user 0c920fcdab46450bb0ad0370a1cc343f and project c7bfc0bf30a64c10ac10270fa96ef591. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:56:18.949356 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:56:18.951462 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:56:19.100121 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ea1a1b5a-f883-414c-bb90-012a922c7494 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765904 Jun 21 16:56:19.100987 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 423/825] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:56:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 16:56:19.102964 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1c4ef522-0acc-4efa-bbd4-9ce7fc4a8c4a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:19.103591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1c4ef522-0acc-4efa-bbd4-9ce7fc4a8c4a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:19.110282 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1c4ef522-0acc-4efa-bbd4-9ce7fc4a8c4a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:19.114379 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1c4ef522-0acc-4efa-bbd4-9ce7fc4a8c4a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:19.114508 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a5595aac-f70f-4633-a85d-90328570c187 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:19.114606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1c4ef522-0acc-4efa-bbd4-9ce7fc4a8c4a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:19.114690 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a5595aac-f70f-4633-a85d-90328570c187 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:19.114814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1c4ef522-0acc-4efa-bbd4-9ce7fc4a8c4a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:19.176631 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a5595aac-f70f-4633-a85d-90328570c187 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:19.188679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a5595aac-f70f-4633-a85d-90328570c187 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1215 microversion: 2.1 time: 0.081755 Jun 21 16:56:19.190901 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 424/826] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:19 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:56:19.264487 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-1c4ef522-0acc-4efa-bbd4-9ce7fc4a8c4a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:19.274550 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1c4ef522-0acc-4efa-bbd4-9ce7fc4a8c4a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1366 microversion: 2.1 time: 0.176399 Jun 21 16:56:19.275342 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 403/827] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:19 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:56:19.583220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3bd28cac-aa90-4fbc-89ff-6436e02114cb tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a4297ed30>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:19.609865 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-3bd28cac-aa90-4fbc-89ff-6436e02114cb tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] HTTP exception thrown: Snapshot 31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 could not be found. Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3bd28cac-aa90-4fbc-89ff-6436e02114cb tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Request method failure captured: Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 HTTP/1.1 Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfgrqcwgkSDbhs8qjamYBY3wtVrSld6BCgEAkYQaTFSrcfilNBzKqj8J7H8RUCgdy0Zk_dDKMWfJmhiBGYzrZosUGdYCpulGRfVUIyicl-uRrLCVl5VXjode5NyqNN6rkNDGtvdyzdAYeXs29MFIjU03TOPYaCBB9wHgabo5MYNApVA Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 3a6c1b2ca3de4e44955dd03ccea30427 Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:56:19.612239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a6c1b2ca3de4e44955dd03ccea30427", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 3a6c1b2ca3de4e44955dd03ccea30427 Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-VolumesSnapshotsTestJSON-2061600990-project Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: ee17c214934b4c19b22571925692c051 Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2061600990-project Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Snapshot 31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 could not be found. Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '31b9f2cc-fdfb-41e6-aec2-e715fcd18a08'} Jun 21 16:56:19.614566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 could not be found. (HTTP 404) (Request-ID: req-890165b4-7925-4b69-b9b4-8702718d3ac2) Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:19.615932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:56:19.617313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 could not be found. Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 16:56:19.621840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 could not be found. Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 could not be found. Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3bd28cac-aa90-4fbc-89ff-6436e02114cb tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Returning 404 to user: Snapshot 31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:19.623337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3bd28cac-aa90-4fbc-89ff-6436e02114cb tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08" status: 404 len: 111 microversion: 2.1 time: 0.034458 Jun 21 16:56:19.624885 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 425/828] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jun 21 16:56:19 2022] GET /compute/v2.1/os-snapshots/31b9f2cc-fdfb-41e6-aec2-e715fcd18a08 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:56:19.624993 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b7c2a8c2-9861-4eca-8548-71fe614942ae tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a4b378dc0>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:19.848816 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b7c2a8c2-9861-4eca-8548-71fe614942ae tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d" status: 202 len: 0 microversion: 2.1 time: 0.227947 Jun 21 16:56:19.849746 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 404/829] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:56:19 2022] DELETE /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 16:56:19.857845 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3e2594aa-9a39-4dd8-b477-d6bdfd9c89d0 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a4298a940>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:19.908197 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3e2594aa-9a39-4dd8-b477-d6bdfd9c89d0 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d" status: 200 len: 345 microversion: 2.1 time: 0.054047 Jun 21 16:56:19.908853 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 426/830] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:56:19 2022] GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:20.206660 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0a151788-3308-4e1d-9482-a2b149f5e3b6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:20.208017 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0a151788-3308-4e1d-9482-a2b149f5e3b6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:20.214301 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0a151788-3308-4e1d-9482-a2b149f5e3b6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:20.214785 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0a151788-3308-4e1d-9482-a2b149f5e3b6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:20.215560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0a151788-3308-4e1d-9482-a2b149f5e3b6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:20.216031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0a151788-3308-4e1d-9482-a2b149f5e3b6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:20.284271 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0a151788-3308-4e1d-9482-a2b149f5e3b6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:20.291699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b03b6240-8790-41e0-bbb1-cc5c345425ed tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:20.292313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0a151788-3308-4e1d-9482-a2b149f5e3b6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1219 microversion: 2.1 time: 0.090268 Jun 21 16:56:20.292462 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b03b6240-8790-41e0-bbb1-cc5c345425ed tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:20.292893 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 405/831] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:20 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:20.298895 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b03b6240-8790-41e0-bbb1-cc5c345425ed tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:20.299537 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b03b6240-8790-41e0-bbb1-cc5c345425ed tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:20.300444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b03b6240-8790-41e0-bbb1-cc5c345425ed tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:20.300950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b03b6240-8790-41e0-bbb1-cc5c345425ed tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:20.443007 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b03b6240-8790-41e0-bbb1-cc5c345425ed tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:20.450856 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b03b6240-8790-41e0-bbb1-cc5c345425ed tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1366 microversion: 2.1 time: 0.163057 Jun 21 16:56:20.451429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 427/832] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:20 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:20.926269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-65c3827f-ffdf-4fe5-a1a2-cf5db35bae01 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a4b378670>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:20.953486 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-65c3827f-ffdf-4fe5-a1a2-cf5db35bae01 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] HTTP exception thrown: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-65c3827f-ffdf-4fe5-a1a2-cf5db35bae01 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Request method failure captured: Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d HTTP/1.1 Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfgrqcwgkSDbhs8qjamYBY3wtVrSld6BCgEAkYQaTFSrcfilNBzKqj8J7H8RUCgdy0Zk_dDKMWfJmhiBGYzrZosUGdYCpulGRfVUIyicl-uRrLCVl5VXjode5NyqNN6rkNDGtvdyzdAYeXs29MFIjU03TOPYaCBB9wHgabo5MYNApVA Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 3a6c1b2ca3de4e44955dd03ccea30427 Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:56:20.955770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a6c1b2ca3de4e44955dd03ccea30427", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 3a6c1b2ca3de4e44955dd03ccea30427 Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-VolumesSnapshotsTestJSON-2061600990-project Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: ee17c214934b4c19b22571925692c051 Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2061600990-project Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '50bad1bd-7868-4b04-bdfa-4890b5b8333d'} Jun 21 16:56:20.957573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. (HTTP 404) (Request-ID: req-5ea38001-f473-414e-a1e5-780129d0ccce) Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:20.967531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:56:20.969076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 16:56:20.970522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-65c3827f-ffdf-4fe5-a1a2-cf5db35bae01 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Returning 404 to user: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-65c3827f-ffdf-4fe5-a1a2-cf5db35bae01 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d" status: 404 len: 109 microversion: 2.1 time: 0.039487 Jun 21 16:56:20.971921 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 406/833] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:56:20 2022] GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:56:20.973154 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1f795068-341e-4c29-ae97-50df09c2af92 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a4298ae50>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:21.003756 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-1f795068-341e-4c29-ae97-50df09c2af92 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] HTTP exception thrown: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1f795068-341e-4c29-ae97-50df09c2af92 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Request method failure captured: Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: DELETE /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d HTTP/1.1 Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfgrqcwgkSDbhs8qjamYBY3wtVrSld6BCgEAkYQaTFSrcfilNBzKqj8J7H8RUCgdy0Zk_dDKMWfJmhiBGYzrZosUGdYCpulGRfVUIyicl-uRrLCVl5VXjode5NyqNN6rkNDGtvdyzdAYeXs29MFIjU03TOPYaCBB9wHgabo5MYNApVA Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 3a6c1b2ca3de4e44955dd03ccea30427 Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:56:21.006941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a6c1b2ca3de4e44955dd03ccea30427", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 3a6c1b2ca3de4e44955dd03ccea30427 Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-VolumesSnapshotsTestJSON-2061600990-project Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: ee17c214934b4c19b22571925692c051 Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2061600990-project Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '50bad1bd-7868-4b04-bdfa-4890b5b8333d'} Jun 21 16:56:21.013860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. (HTTP 404) (Request-ID: req-7326468f-2c0e-45fd-911a-571ed796dab5) Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:21.015307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 16:56:21.017559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 16:56:21.020449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1f795068-341e-4c29-ae97-50df09c2af92 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Returning 404 to user: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1f795068-341e-4c29-ae97-50df09c2af92 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d" status: 404 len: 109 microversion: 2.1 time: 0.039678 Jun 21 16:56:21.021892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 428/834] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:56:20 2022] DELETE /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:56:21.024000 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5d5e75ee-12a6-450b-9ebd-8214f387f3d8 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Calling method '.version_select at 0x7f0a4b37f940>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:21.054155 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-5d5e75ee-12a6-450b-9ebd-8214f387f3d8 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] HTTP exception thrown: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5d5e75ee-12a6-450b-9ebd-8214f387f3d8 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Request method failure captured: Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d HTTP/1.1 Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfgrqcwgkSDbhs8qjamYBY3wtVrSld6BCgEAkYQaTFSrcfilNBzKqj8J7H8RUCgdy0Zk_dDKMWfJmhiBGYzrZosUGdYCpulGRfVUIyicl-uRrLCVl5VXjode5NyqNN6rkNDGtvdyzdAYeXs29MFIjU03TOPYaCBB9wHgabo5MYNApVA Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 3a6c1b2ca3de4e44955dd03ccea30427 Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:56:21.056104 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a6c1b2ca3de4e44955dd03ccea30427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a6c1b2ca3de4e44955dd03ccea30427", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 3a6c1b2ca3de4e44955dd03ccea30427 Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2061600990 Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-VolumesSnapshotsTestJSON-2061600990-project Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: ee17c214934b4c19b22571925692c051 Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2061600990-project Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '50bad1bd-7868-4b04-bdfa-4890b5b8333d'} Jun 21 16:56:21.057814 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. (HTTP 404) (Request-ID: req-534ad090-acb0-476d-a77f-3227d0911b68) Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:21.058849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 16:56:21.060241 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 16:56:21.067108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5d5e75ee-12a6-450b-9ebd-8214f387f3d8 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] Returning 404 to user: Volume 50bad1bd-7868-4b04-bdfa-4890b5b8333d could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5d5e75ee-12a6-450b-9ebd-8214f387f3d8 tempest-VolumesSnapshotsTestJSON-2061600990 tempest-VolumesSnapshotsTestJSON-2061600990-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d" status: 404 len: 109 microversion: 2.1 time: 0.042563 Jun 21 16:56:21.069064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 407/835] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 16:56:21 2022] GET /compute/v2.1/os-volumes/50bad1bd-7868-4b04-bdfa-4890b5b8333d => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:56:21.311120 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-bfcff120-9c47-44e8-adfa-c30c982047c6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:21.311755 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-bfcff120-9c47-44e8-adfa-c30c982047c6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:21.319874 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bfcff120-9c47-44e8-adfa-c30c982047c6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:21.320319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bfcff120-9c47-44e8-adfa-c30c982047c6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:21.321086 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bfcff120-9c47-44e8-adfa-c30c982047c6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:21.321563 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-bfcff120-9c47-44e8-adfa-c30c982047c6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:21.392114 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-bfcff120-9c47-44e8-adfa-c30c982047c6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:21.401584 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-bfcff120-9c47-44e8-adfa-c30c982047c6 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1267 microversion: 2.1 time: 0.094313 Jun 21 16:56:21.410979 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 429/836] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:21 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:21.465481 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=6 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:21.470238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c17eaa46-e4c0-42e2-a939-ce1a9fed042a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:21.470895 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c17eaa46-e4c0-42e2-a939-ce1a9fed042a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:21.478718 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c17eaa46-e4c0-42e2-a939-ce1a9fed042a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:21.479197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c17eaa46-e4c0-42e2-a939-ce1a9fed042a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:21.480020 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c17eaa46-e4c0-42e2-a939-ce1a9fed042a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:21.480444 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c17eaa46-e4c0-42e2-a939-ce1a9fed042a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:21.726691 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c17eaa46-e4c0-42e2-a939-ce1a9fed042a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:21.736015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c17eaa46-e4c0-42e2-a939-ce1a9fed042a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1366 microversion: 2.1 time: 0.271536 Jun 21 16:56:21.736746 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 408/837] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:21 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:22.419450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fc805cbf-584f-4c81-acf6-bfba9da47a18 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:22.420056 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fc805cbf-584f-4c81-acf6-bfba9da47a18 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:22.429060 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc805cbf-584f-4c81-acf6-bfba9da47a18 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:22.429663 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc805cbf-584f-4c81-acf6-bfba9da47a18 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:22.430560 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc805cbf-584f-4c81-acf6-bfba9da47a18 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:22.435901 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc805cbf-584f-4c81-acf6-bfba9da47a18 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:22.507386 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fc805cbf-584f-4c81-acf6-bfba9da47a18 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:22.514814 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fc805cbf-584f-4c81-acf6-bfba9da47a18 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1273 microversion: 2.1 time: 0.099369 Jun 21 16:56:22.516377 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 430/838] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:22 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:22.753025 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f66d71a7-0181-4ad8-be58-50f1ff185c8e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:22.753665 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f66d71a7-0181-4ad8-be58-50f1ff185c8e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:22.762398 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f66d71a7-0181-4ad8-be58-50f1ff185c8e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:22.763194 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f66d71a7-0181-4ad8-be58-50f1ff185c8e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:22.763623 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f66d71a7-0181-4ad8-be58-50f1ff185c8e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:22.764054 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f66d71a7-0181-4ad8-be58-50f1ff185c8e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:23.001984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f66d71a7-0181-4ad8-be58-50f1ff185c8e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:23.013935 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f66d71a7-0181-4ad8-be58-50f1ff185c8e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1366 microversion: 2.1 time: 0.263131 Jun 21 16:56:23.016026 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 409/839] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:22 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:23.065235 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-bf1eec46-5011-4b7a-8da7-863b52c728a4 req-b9e68ede-3fb1-480a-9111-cec41c4433af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0967ec-4512-4953-8d0c-cd5c2616341c", "name": "network-vif-plugged", "status": "completed", "tag": "7cb6c36c-9757-4544-9b68-2781176ab5c4"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:23.075279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-bf1eec46-5011-4b7a-8da7-863b52c728a4 req-b9e68ede-3fb1-480a-9111-cec41c4433af service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:23.075730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-bf1eec46-5011-4b7a-8da7-863b52c728a4 req-b9e68ede-3fb1-480a-9111-cec41c4433af service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:23.089174 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-bf1eec46-5011-4b7a-8da7-863b52c728a4 req-b9e68ede-3fb1-480a-9111-cec41c4433af service nova] Creating event network-vif-plugged:7cb6c36c-9757-4544-9b68-2781176ab5c4 for instance 5e0967ec-4512-4953-8d0c-cd5c2616341c on hv-cinder-79987 Jun 21 16:56:23.093319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-bf1eec46-5011-4b7a-8da7-863b52c728a4 req-b9e68ede-3fb1-480a-9111-cec41c4433af service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032570 Jun 21 16:56:23.093966 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 431/840] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:23.532665 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d9b7223b-4999-4357-a431-54a661d7a4b7 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:23.533426 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d9b7223b-4999-4357-a431-54a661d7a4b7 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:23.541662 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d9b7223b-4999-4357-a431-54a661d7a4b7 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:23.544884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d9b7223b-4999-4357-a431-54a661d7a4b7 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:23.544884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d9b7223b-4999-4357-a431-54a661d7a4b7 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:23.544884 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d9b7223b-4999-4357-a431-54a661d7a4b7 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:23.977301 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d9b7223b-4999-4357-a431-54a661d7a4b7 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:23.986518 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d9b7223b-4999-4357-a431-54a661d7a4b7 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.458389 Jun 21 16:56:23.989326 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 410/841] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:23 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:24.033469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4ebf51d5-cfe3-4854-9404-c524cb42f119 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:24.034187 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4ebf51d5-cfe3-4854-9404-c524cb42f119 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:24.044878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4ebf51d5-cfe3-4854-9404-c524cb42f119 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:24.046076 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4ebf51d5-cfe3-4854-9404-c524cb42f119 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:24.047516 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4ebf51d5-cfe3-4854-9404-c524cb42f119 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:24.048296 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4ebf51d5-cfe3-4854-9404-c524cb42f119 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:24.304867 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4ebf51d5-cfe3-4854-9404-c524cb42f119 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:24.315861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4ebf51d5-cfe3-4854-9404-c524cb42f119 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1366 microversion: 2.1 time: 0.286887 Jun 21 16:56:24.318159 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 432/842] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:24 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:24.482572 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-f4f1db7a-2975-4c4a-ac7c-68622e092882 req-2df6bd95-76c8-41e8-9296-2dcdcec5b508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c78a12c-b246-42b4-9c41-76ecbf114b9a", "tag": "3d11a386-6ce0-41ec-9092-dd0dd79b88e3"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:24.491513 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-f4f1db7a-2975-4c4a-ac7c-68622e092882 req-2df6bd95-76c8-41e8-9296-2dcdcec5b508 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:24.491846 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-f4f1db7a-2975-4c4a-ac7c-68622e092882 req-2df6bd95-76c8-41e8-9296-2dcdcec5b508 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:24.515203 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-f4f1db7a-2975-4c4a-ac7c-68622e092882 req-2df6bd95-76c8-41e8-9296-2dcdcec5b508 service nova] Creating event network-changed:3d11a386-6ce0-41ec-9092-dd0dd79b88e3 for instance 7c78a12c-b246-42b4-9c41-76ecbf114b9a on hv-cinder-79987 Jun 21 16:56:24.521484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-f4f1db7a-2975-4c4a-ac7c-68622e092882 req-2df6bd95-76c8-41e8-9296-2dcdcec5b508 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043113 Jun 21 16:56:24.522247 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 411/843] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:25.005618 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b2cbd862-55e5-4204-91bd-c4b779ed84ad tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:25.006343 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b2cbd862-55e5-4204-91bd-c4b779ed84ad tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:25.012710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b2cbd862-55e5-4204-91bd-c4b779ed84ad tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:25.013257 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b2cbd862-55e5-4204-91bd-c4b779ed84ad tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:25.014043 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b2cbd862-55e5-4204-91bd-c4b779ed84ad tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:25.014554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b2cbd862-55e5-4204-91bd-c4b779ed84ad tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:25.151178 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b2cbd862-55e5-4204-91bd-c4b779ed84ad tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:25.158685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b2cbd862-55e5-4204-91bd-c4b779ed84ad tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.157887 Jun 21 16:56:25.159537 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 433/844] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:24 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:25.336633 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0295bb12-f32e-486b-a14c-413f3b2e3fb5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:25.337645 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0295bb12-f32e-486b-a14c-413f3b2e3fb5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:25.343671 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0295bb12-f32e-486b-a14c-413f3b2e3fb5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:25.345527 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0295bb12-f32e-486b-a14c-413f3b2e3fb5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:25.345527 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0295bb12-f32e-486b-a14c-413f3b2e3fb5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:25.345527 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0295bb12-f32e-486b-a14c-413f3b2e3fb5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:25.601721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0295bb12-f32e-486b-a14c-413f3b2e3fb5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:25.609488 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0295bb12-f32e-486b-a14c-413f3b2e3fb5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1557 microversion: 2.1 time: 0.278709 Jun 21 16:56:25.610062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 412/845] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:25 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1557 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:25.628871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-05fd4d38-3f77-4393-ac0a-23c8dcb29134 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:25.630278 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-05fd4d38-3f77-4393-ac0a-23c8dcb29134 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:25.636911 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-05fd4d38-3f77-4393-ac0a-23c8dcb29134 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:25.637458 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-05fd4d38-3f77-4393-ac0a-23c8dcb29134 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:25.638220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-05fd4d38-3f77-4393-ac0a-23c8dcb29134 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:25.638663 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-05fd4d38-3f77-4393-ac0a-23c8dcb29134 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:25.642979 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:25.727789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-05fd4d38-3f77-4393-ac0a-23c8dcb29134 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102790 Jun 21 16:56:25.728496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 434/846] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 16:56:25 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:26.175820 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bc0e7f01-5d4a-47f9-afb4-c967ff51c682 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:26.177148 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bc0e7f01-5d4a-47f9-afb4-c967ff51c682 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:26.179187 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:26.184059 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bc0e7f01-5d4a-47f9-afb4-c967ff51c682 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:26.184501 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bc0e7f01-5d4a-47f9-afb4-c967ff51c682 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:26.185264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bc0e7f01-5d4a-47f9-afb4-c967ff51c682 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:26.185722 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bc0e7f01-5d4a-47f9-afb4-c967ff51c682 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:26.189838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:26.409005 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bc0e7f01-5d4a-47f9-afb4-c967ff51c682 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:26.416969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bc0e7f01-5d4a-47f9-afb4-c967ff51c682 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.244870 Jun 21 16:56:26.417575 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 413/847] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:26 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:27.078128 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-ac2964ed-02bc-4122-85f7-857e945751bc req-57788e84-2cbb-4448-aa96-138db1ecb18e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e0967ec-4512-4953-8d0c-cd5c2616341c", "tag": "7cb6c36c-9757-4544-9b68-2781176ab5c4"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:27.086240 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:27.089552 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-ac2964ed-02bc-4122-85f7-857e945751bc req-57788e84-2cbb-4448-aa96-138db1ecb18e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:27.090163 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-ac2964ed-02bc-4122-85f7-857e945751bc req-57788e84-2cbb-4448-aa96-138db1ecb18e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:27.102811 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-ac2964ed-02bc-4122-85f7-857e945751bc req-57788e84-2cbb-4448-aa96-138db1ecb18e service nova] Creating event network-changed:7cb6c36c-9757-4544-9b68-2781176ab5c4 for instance 5e0967ec-4512-4953-8d0c-cd5c2616341c on hv-cinder-79987 Jun 21 16:56:27.107625 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-ac2964ed-02bc-4122-85f7-857e945751bc req-57788e84-2cbb-4448-aa96-138db1ecb18e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033707 Jun 21 16:56:27.108225 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 435/848] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:27.433864 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0c0abf0e-2450-48e3-bd96-12b0325c364f tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:27.434825 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0c0abf0e-2450-48e3-bd96-12b0325c364f tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:27.443607 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0c0abf0e-2450-48e3-bd96-12b0325c364f tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:27.444454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0c0abf0e-2450-48e3-bd96-12b0325c364f tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:27.445691 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0c0abf0e-2450-48e3-bd96-12b0325c364f tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:27.446280 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0c0abf0e-2450-48e3-bd96-12b0325c364f tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:27.683859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0c0abf0e-2450-48e3-bd96-12b0325c364f tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:27.691512 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0c0abf0e-2450-48e3-bd96-12b0325c364f tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.261389 Jun 21 16:56:27.692845 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 414/849] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:27 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:28.714031 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9e708ba6-81b7-4e55-9da1-c59db950ef16 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:28.714885 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9e708ba6-81b7-4e55-9da1-c59db950ef16 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:28.722682 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9e708ba6-81b7-4e55-9da1-c59db950ef16 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:28.723366 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9e708ba6-81b7-4e55-9da1-c59db950ef16 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:28.724243 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9e708ba6-81b7-4e55-9da1-c59db950ef16 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:28.724684 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9e708ba6-81b7-4e55-9da1-c59db950ef16 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:28.871787 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9e708ba6-81b7-4e55-9da1-c59db950ef16 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:28.886063 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9e708ba6-81b7-4e55-9da1-c59db950ef16 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.177685 Jun 21 16:56:28.901681 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 436/850] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:28 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:29.914867 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-eb76803b-0458-47a8-ace9-db2f19cff0fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:29.915470 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-eb76803b-0458-47a8-ace9-db2f19cff0fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:29.922829 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-eb76803b-0458-47a8-ace9-db2f19cff0fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:29.923276 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-eb76803b-0458-47a8-ace9-db2f19cff0fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:29.924040 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-eb76803b-0458-47a8-ace9-db2f19cff0fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:29.924596 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-eb76803b-0458-47a8-ace9-db2f19cff0fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:30.069998 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-eb76803b-0458-47a8-ace9-db2f19cff0fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:30.080533 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-eb76803b-0458-47a8-ace9-db2f19cff0fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.170576 Jun 21 16:56:30.081450 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 415/851] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:29 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:31.025899 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-6eb9e178-2b33-4fa7-8414-999501f9bc7c req-429e4883-8f77-4e09-b3ed-bef1276f0d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c78a12c-b246-42b4-9c41-76ecbf114b9a", "name": "network-vif-plugged", "status": "completed", "tag": "3d11a386-6ce0-41ec-9092-dd0dd79b88e3"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:31.030185 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=4 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:31.030929 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=14 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:56:31.037923 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6eb9e178-2b33-4fa7-8414-999501f9bc7c req-429e4883-8f77-4e09-b3ed-bef1276f0d8e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:31.038366 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6eb9e178-2b33-4fa7-8414-999501f9bc7c req-429e4883-8f77-4e09-b3ed-bef1276f0d8e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:31.049675 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-6eb9e178-2b33-4fa7-8414-999501f9bc7c req-429e4883-8f77-4e09-b3ed-bef1276f0d8e service nova] Creating event network-vif-plugged:3d11a386-6ce0-41ec-9092-dd0dd79b88e3 for instance 7c78a12c-b246-42b4-9c41-76ecbf114b9a on hv-cinder-79987 Jun 21 16:56:31.055262 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-6eb9e178-2b33-4fa7-8414-999501f9bc7c req-429e4883-8f77-4e09-b3ed-bef1276f0d8e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033134 Jun 21 16:56:31.055889 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 437/852] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:31.099727 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e6218c9e-76a6-47a8-97ba-21bca58e0caf tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:31.100377 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e6218c9e-76a6-47a8-97ba-21bca58e0caf tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:31.107159 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e6218c9e-76a6-47a8-97ba-21bca58e0caf tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:31.107607 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e6218c9e-76a6-47a8-97ba-21bca58e0caf tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:31.108391 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e6218c9e-76a6-47a8-97ba-21bca58e0caf tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:31.108827 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e6218c9e-76a6-47a8-97ba-21bca58e0caf tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:31.256310 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e6218c9e-76a6-47a8-97ba-21bca58e0caf tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:31.266202 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e6218c9e-76a6-47a8-97ba-21bca58e0caf tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.171284 Jun 21 16:56:31.266787 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 416/853] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:31 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:32.285945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0b4409d4-a4b4-4f33-b85e-c67a39140a4b tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:32.287320 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-0b4409d4-a4b4-4f33-b85e-c67a39140a4b tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:32.295551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0b4409d4-a4b4-4f33-b85e-c67a39140a4b tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:32.295991 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0b4409d4-a4b4-4f33-b85e-c67a39140a4b tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:32.296806 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0b4409d4-a4b4-4f33-b85e-c67a39140a4b tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:32.297380 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-0b4409d4-a4b4-4f33-b85e-c67a39140a4b tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:32.442785 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-0b4409d4-a4b4-4f33-b85e-c67a39140a4b tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:32.450463 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0b4409d4-a4b4-4f33-b85e-c67a39140a4b tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.169746 Jun 21 16:56:32.451031 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 438/854] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:32 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:33.466506 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4a12a6c8-5336-48a8-969d-2d2c712d2ad9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:33.467036 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4a12a6c8-5336-48a8-969d-2d2c712d2ad9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:33.474106 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4a12a6c8-5336-48a8-969d-2d2c712d2ad9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:33.474338 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4a12a6c8-5336-48a8-969d-2d2c712d2ad9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:33.475096 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4a12a6c8-5336-48a8-969d-2d2c712d2ad9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:33.475624 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4a12a6c8-5336-48a8-969d-2d2c712d2ad9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:33.603081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4a12a6c8-5336-48a8-969d-2d2c712d2ad9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:33.610555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4a12a6c8-5336-48a8-969d-2d2c712d2ad9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.147960 Jun 21 16:56:33.611134 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 417/855] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:33 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:34.628001 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b03b2706-2c2e-49ed-af1c-c7657d460cfe tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:34.628620 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b03b2706-2c2e-49ed-af1c-c7657d460cfe tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:34.635883 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b03b2706-2c2e-49ed-af1c-c7657d460cfe tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:34.636334 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b03b2706-2c2e-49ed-af1c-c7657d460cfe tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:34.637102 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b03b2706-2c2e-49ed-af1c-c7657d460cfe tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:34.637608 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b03b2706-2c2e-49ed-af1c-c7657d460cfe tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:34.778011 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b03b2706-2c2e-49ed-af1c-c7657d460cfe tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:34.786403 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b03b2706-2c2e-49ed-af1c-c7657d460cfe tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.161586 Jun 21 16:56:34.787105 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 439/856] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:34 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:35.803295 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cc0d39a4-9da2-4bfe-9173-e020fbbfb7fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:35.803926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cc0d39a4-9da2-4bfe-9173-e020fbbfb7fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:35.810559 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc0d39a4-9da2-4bfe-9173-e020fbbfb7fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:35.811011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc0d39a4-9da2-4bfe-9173-e020fbbfb7fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:35.811775 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc0d39a4-9da2-4bfe-9173-e020fbbfb7fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:35.812213 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cc0d39a4-9da2-4bfe-9173-e020fbbfb7fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:35.949087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cc0d39a4-9da2-4bfe-9173-e020fbbfb7fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:35.956731 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cc0d39a4-9da2-4bfe-9173-e020fbbfb7fd tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1315 microversion: 2.1 time: 0.157791 Jun 21 16:56:35.957318 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 418/857] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:35 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:36.972913 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-00e71863-d909-47c6-a128-eaaa2193a73e tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:36.974917 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-00e71863-d909-47c6-a128-eaaa2193a73e tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:36.981479 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-00e71863-d909-47c6-a128-eaaa2193a73e tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:36.981923 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-00e71863-d909-47c6-a128-eaaa2193a73e tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:36.982685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-00e71863-d909-47c6-a128-eaaa2193a73e tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:36.983102 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-00e71863-d909-47c6-a128-eaaa2193a73e tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:37.124714 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-00e71863-d909-47c6-a128-eaaa2193a73e tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:37.133218 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-00e71863-d909-47c6-a128-eaaa2193a73e tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1464 microversion: 2.1 time: 0.164067 Jun 21 16:56:37.134045 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 440/858] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:36 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:37.178015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7348fa2b-2dab-44a3-b658-ebdbde6c1d6d tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:37.178762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-7348fa2b-2dab-44a3-b658-ebdbde6c1d6d tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:37.185123 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7348fa2b-2dab-44a3-b658-ebdbde6c1d6d tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:37.186226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7348fa2b-2dab-44a3-b658-ebdbde6c1d6d tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:37.186547 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7348fa2b-2dab-44a3-b658-ebdbde6c1d6d tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:37.187142 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7348fa2b-2dab-44a3-b658-ebdbde6c1d6d tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:37.213528 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-7348fa2b-2dab-44a3-b658-ebdbde6c1d6d tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:56:37.601439 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-7348fa2b-2dab-44a3-b658-ebdbde6c1d6d tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 204 len: 0 microversion: 2.1 time: 0.427639 Jun 21 16:56:37.602348 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 419/859] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:56:37 2022] DELETE /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:56:37.610443 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1ca4d3fa-3f70-4d5c-92eb-5db0c701877a tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:37.611053 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1ca4d3fa-3f70-4d5c-92eb-5db0c701877a tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:37.619762 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1ca4d3fa-3f70-4d5c-92eb-5db0c701877a tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:37.620219 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1ca4d3fa-3f70-4d5c-92eb-5db0c701877a tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:37.620994 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1ca4d3fa-3f70-4d5c-92eb-5db0c701877a tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:37.621615 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1ca4d3fa-3f70-4d5c-92eb-5db0c701877a tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:37.759840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1ca4d3fa-3f70-4d5c-92eb-5db0c701877a tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:37.767404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1ca4d3fa-3f70-4d5c-92eb-5db0c701877a tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1470 microversion: 2.1 time: 0.160822 Jun 21 16:56:37.770912 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 441/860] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:37 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:38.786722 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d95f480f-3331-466f-9800-e1c3dd55d72c tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:38.787417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d95f480f-3331-466f-9800-e1c3dd55d72c tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:38.794175 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d95f480f-3331-466f-9800-e1c3dd55d72c tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:38.794622 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d95f480f-3331-466f-9800-e1c3dd55d72c tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:38.795384 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d95f480f-3331-466f-9800-e1c3dd55d72c tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:38.795813 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d95f480f-3331-466f-9800-e1c3dd55d72c tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:38.929328 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d95f480f-3331-466f-9800-e1c3dd55d72c tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:38.936775 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d95f480f-3331-466f-9800-e1c3dd55d72c tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1470 microversion: 2.1 time: 0.155178 Jun 21 16:56:38.941082 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 420/861] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:38 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:56:39.954641 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ae22206c-fb32-4421-a94f-ad59fb08aa67 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:39.955194 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ae22206c-fb32-4421-a94f-ad59fb08aa67 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:39.961813 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae22206c-fb32-4421-a94f-ad59fb08aa67 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:39.962264 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae22206c-fb32-4421-a94f-ad59fb08aa67 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:39.963047 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae22206c-fb32-4421-a94f-ad59fb08aa67 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:39.963482 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ae22206c-fb32-4421-a94f-ad59fb08aa67 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:40.092902 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ae22206c-fb32-4421-a94f-ad59fb08aa67 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:40.101143 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ae22206c-fb32-4421-a94f-ad59fb08aa67 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1470 microversion: 2.1 time: 0.150510 Jun 21 16:56:40.101822 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 442/862] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:39 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:56:41.118850 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ae950108-d6f8-44ef-ade7-24b2ef21adb2 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:41.119483 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ae950108-d6f8-44ef-ade7-24b2ef21adb2 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:41.126172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae950108-d6f8-44ef-ade7-24b2ef21adb2 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:41.128812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae950108-d6f8-44ef-ade7-24b2ef21adb2 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:41.128812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae950108-d6f8-44ef-ade7-24b2ef21adb2 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:41.128812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ae950108-d6f8-44ef-ade7-24b2ef21adb2 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:41.260073 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ae950108-d6f8-44ef-ade7-24b2ef21adb2 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:41.268015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ae950108-d6f8-44ef-ade7-24b2ef21adb2 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1470 microversion: 2.1 time: 0.152992 Jun 21 16:56:41.268585 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 421/863] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:41 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:56:42.285442 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a4f596a7-204e-4141-95bb-e7674b913ab3 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:42.287376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a4f596a7-204e-4141-95bb-e7674b913ab3 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:42.294430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a4f596a7-204e-4141-95bb-e7674b913ab3 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:42.294881 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a4f596a7-204e-4141-95bb-e7674b913ab3 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:42.295631 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a4f596a7-204e-4141-95bb-e7674b913ab3 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:42.296056 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a4f596a7-204e-4141-95bb-e7674b913ab3 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:42.441092 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a4f596a7-204e-4141-95bb-e7674b913ab3 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:42.455648 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a4f596a7-204e-4141-95bb-e7674b913ab3 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1470 microversion: 2.1 time: 0.174078 Jun 21 16:56:42.456782 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 443/864] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:42 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:42.522563 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-2f110113-7812-4dc3-af59-a1338ba4b746 req-a8497a93-6f90-4e80-950d-520c8c1a9e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c78a12c-b246-42b4-9c41-76ecbf114b9a", "name": "network-vif-deleted", "tag": "3d11a386-6ce0-41ec-9092-dd0dd79b88e3"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:56:42.530805 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-2f110113-7812-4dc3-af59-a1338ba4b746 req-a8497a93-6f90-4e80-950d-520c8c1a9e87 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:42.531251 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-2f110113-7812-4dc3-af59-a1338ba4b746 req-a8497a93-6f90-4e80-950d-520c8c1a9e87 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:42.543666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-2f110113-7812-4dc3-af59-a1338ba4b746 req-a8497a93-6f90-4e80-950d-520c8c1a9e87 service nova] Creating event network-vif-deleted:3d11a386-6ce0-41ec-9092-dd0dd79b88e3 for instance 7c78a12c-b246-42b4-9c41-76ecbf114b9a on hv-cinder-79987 Jun 21 16:56:42.551584 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-2f110113-7812-4dc3-af59-a1338ba4b746 req-a8497a93-6f90-4e80-950d-520c8c1a9e87 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032930 Jun 21 16:56:42.552595 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 422/865] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:56:43.473481 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:43.474078 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:43.480558 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:43.481003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:43.481861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:43.482292 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:43.515358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:43.515806 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:43.516363 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lazy-loading 'fault' on Instance uuid 7c78a12c-b246-42b4-9c41-76ecbf114b9a {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:56:43.560468 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:43.569360 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6a13398d-7e3e-45fc-ae09-28d78fb022a9 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1305 microversion: 2.1 time: 0.099792 Jun 21 16:56:43.571890 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 444/866] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:43 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:44.588459 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:44.589080 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:44.595446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:44.595893 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:44.596660 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:44.597110 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:44.630935 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:44.631377 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:44.631819 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lazy-loading 'fault' on Instance uuid 7c78a12c-b246-42b4-9c41-76ecbf114b9a {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:56:44.676137 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c920fcdab46450bb0ad0370a1cc343f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7bfc0bf30a64c10ac10270fa96ef591', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:56:44.684412 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4feef8aa-b88d-4b3a-ba81-89032b1f99eb tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 200 len: 1305 microversion: 2.1 time: 0.101516 Jun 21 16:56:44.685031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 423/867] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:44 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:56:45.705477 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:56:45.706498 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] [instance: 7c78a12c-b246-42b4-9c41-76ecbf114b9a] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:56:45.716190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:45.716643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:45.717451 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:56:45.717882 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:56:45.731444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] HTTP exception thrown: Instance 7c78a12c-b246-42b4-9c41-76ecbf114b9a could not be found. Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Request method failure captured: Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a HTTP/1.1 Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfgtUNwZ53eI45qtGBLM3H9EfFkA3DsyZ_rbZdIO5ajIT0UOA0B7EBldEVj7iVncC7-3bH9zPhUDDB75i4BsPzAbmCbI8NYGnHQWJV_VN9Y6fIB8DyUs5wn7CJosRzY1QvKW7xToah9GOSICc5GSmUnSKR8eVyup_vFJvP4DCBvqiC0 Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: c7bfc0bf30a64c10ac10270fa96ef591 Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-VolumesNegativeTest-24141977 Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:56:45.733081 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c7bfc0bf30a64c10ac10270fa96ef591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c7bfc0bf30a64c10ac10270fa96ef591"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c7bfc0bf30a64c10ac10270fa96ef591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c7bfc0bf30a64c10ac10270fa96ef591", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-VolumesNegativeTest-24141977 Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: c7bfc0bf30a64c10ac10270fa96ef591 Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-VolumesNegativeTest-24141977 Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-VolumesNegativeTest-24141977-project Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 0c920fcdab46450bb0ad0370a1cc343f Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-VolumesNegativeTest-24141977-project Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 7c78a12c-b246-42b4-9c41-76ecbf114b9a could not be found. Jun 21 16:56:45.734919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '7c78a12c-b246-42b4-9c41-76ecbf114b9a'} Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c78a12c-b246-42b4-9c41-76ecbf114b9a could not be found. Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:56:45.735907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c78a12c-b246-42b4-9c41-76ecbf114b9a could not be found. Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c78a12c-b246-42b4-9c41-76ecbf114b9a could not be found. Jun 21 16:56:45.737342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:56:45.739123 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] Returning 404 to user: Instance 7c78a12c-b246-42b4-9c41-76ecbf114b9a could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:56:45.739123 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6556bd6f-7029-477c-bd9b-b1fa69f62497 tempest-VolumesNegativeTest-24141977 tempest-VolumesNegativeTest-24141977-project] 10.222.0.70 "GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a" status: 404 len: 111 microversion: 2.1 time: 0.035723 Jun 21 16:56:45.739123 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 445/868] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:56:45 2022] GET /compute/v2.1/servers/7c78a12c-b246-42b4-9c41-76ecbf114b9a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:57:00.783494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2038195738", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "networks": [{"uuid": "09788440-c818-4ffe-850a-f3f22fe9f60f"}]}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:00.791953 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:00.792613 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:00.837911 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.network.neutron [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] validate_networks() for [('09788440-c818-4ffe-850a-f3f22fe9f60f', None, None, None, None, None)] {{(pid=124686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:57:01.190927 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Flavor limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:57:01.191350 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Image limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:57:01.191839 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Flavor pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:57:01.192248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Image pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:57:01.192657 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:57:01.201874 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:01.202258 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:01.203134 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:01.203567 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:01.222204 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Getting quotas for project 7dddfcc30ee8433c9f48d7153b416f21. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:57:01.226868 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Getting quotas for user dfc90b18a1f44d1eb1bba4e64fa1d3a1 and project 7dddfcc30ee8433c9f48d7153b416f21. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:57:01.237597 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Going to run 1 instances... {{(pid=124686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:57:01.239818 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:57:01.362341 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9a9258bd-54f0-4e53-a8cd-235424f3a1dc tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582669 Jun 21 16:57:01.362985 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 424/869] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:57:01.372858 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9909d221-2c7e-4d13-8824-ccd03c42bdd2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:01.373505 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9909d221-2c7e-4d13-8824-ccd03c42bdd2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:01.375843 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=23 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:01.376486 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=58 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:01.430197 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9909d221-2c7e-4d13-8824-ccd03c42bdd2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:01.437309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9909d221-2c7e-4d13-8824-ccd03c42bdd2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1219 microversion: 2.1 time: 0.068345 Jun 21 16:57:01.440472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 446/870] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:01 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:02.459707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0b19c4b1-9e2c-4c9d-8291-33053991b1a4 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:02.460361 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0b19c4b1-9e2c-4c9d-8291-33053991b1a4 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:02.536510 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0b19c4b1-9e2c-4c9d-8291-33053991b1a4 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:02.544020 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0b19c4b1-9e2c-4c9d-8291-33053991b1a4 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1219 microversion: 2.1 time: 0.088998 Jun 21 16:57:02.544600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 425/871] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:02 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:02.638001 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1db98fdf-ef0d-48fe-b5ad-989b729746f7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:02.639078 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1db98fdf-ef0d-48fe-b5ad-989b729746f7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:02.643694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-0693cf37-6394-471f-a92b-20c54db27980 req-e97de3a1-19d6-4813-8f25-c18ee19f7b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c7a8e0-22b7-46fd-8a39-03e153ce2dc4", "tag": "abae0918-ee64-4a4d-89a7-fad9196b8160"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:02.648545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1db98fdf-ef0d-48fe-b5ad-989b729746f7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:02.649000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1db98fdf-ef0d-48fe-b5ad-989b729746f7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:02.656457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1db98fdf-ef0d-48fe-b5ad-989b729746f7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:02.656457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1db98fdf-ef0d-48fe-b5ad-989b729746f7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:02.656679 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-0693cf37-6394-471f-a92b-20c54db27980 req-e97de3a1-19d6-4813-8f25-c18ee19f7b44 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:02.656679 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-0693cf37-6394-471f-a92b-20c54db27980 req-e97de3a1-19d6-4813-8f25-c18ee19f7b44 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:02.668610 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-0693cf37-6394-471f-a92b-20c54db27980 req-e97de3a1-19d6-4813-8f25-c18ee19f7b44 service nova] Creating event network-changed:abae0918-ee64-4a4d-89a7-fad9196b8160 for instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 on hv-cinder-79987 Jun 21 16:57:02.679174 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1db98fdf-ef0d-48fe-b5ad-989b729746f7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Going to try to terminate instance {{(pid=124685) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:57:02.695821 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-0693cf37-6394-471f-a92b-20c54db27980 req-e97de3a1-19d6-4813-8f25-c18ee19f7b44 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045772 Jun 21 16:57:02.695821 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 426/872] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:03.139194 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1db98fdf-ef0d-48fe-b5ad-989b729746f7 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "DELETE /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 204 len: 0 microversion: 2.1 time: 0.505371 Jun 21 16:57:03.143073 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 447/873] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:57:02 2022] DELETE /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:57:03.148707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9cad5de6-d4d1-4eed-b20b-e85cf557485d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:03.149581 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9cad5de6-d4d1-4eed-b20b-e85cf557485d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:03.156895 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9cad5de6-d4d1-4eed-b20b-e85cf557485d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:03.157515 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9cad5de6-d4d1-4eed-b20b-e85cf557485d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:03.158597 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9cad5de6-d4d1-4eed-b20b-e85cf557485d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:03.159129 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9cad5de6-d4d1-4eed-b20b-e85cf557485d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:03.317231 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9cad5de6-d4d1-4eed-b20b-e85cf557485d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:03.325555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9cad5de6-d4d1-4eed-b20b-e85cf557485d tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.181067 Jun 21 16:57:03.326146 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 427/874] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:03 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:03.562061 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-baf481f7-c4d7-48ca-ac86-7870f2ec6170 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:03.562786 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-baf481f7-c4d7-48ca-ac86-7870f2ec6170 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:03.571684 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-baf481f7-c4d7-48ca-ac86-7870f2ec6170 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:03.572134 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-baf481f7-c4d7-48ca-ac86-7870f2ec6170 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:03.573228 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-baf481f7-c4d7-48ca-ac86-7870f2ec6170 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:03.573690 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-baf481f7-c4d7-48ca-ac86-7870f2ec6170 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:03.645561 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-baf481f7-c4d7-48ca-ac86-7870f2ec6170 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:03.654749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-baf481f7-c4d7-48ca-ac86-7870f2ec6170 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1215 microversion: 2.1 time: 0.097222 Jun 21 16:57:03.658870 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 448/875] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:03 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:04.344066 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-08f432e1-430e-4379-aea3-8b5226a5b274 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:04.344697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-08f432e1-430e-4379-aea3-8b5226a5b274 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:04.351843 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-08f432e1-430e-4379-aea3-8b5226a5b274 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:04.352283 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-08f432e1-430e-4379-aea3-8b5226a5b274 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:04.353034 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-08f432e1-430e-4379-aea3-8b5226a5b274 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:04.353494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-08f432e1-430e-4379-aea3-8b5226a5b274 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:04.487178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-08f432e1-430e-4379-aea3-8b5226a5b274 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:04.495916 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-08f432e1-430e-4379-aea3-8b5226a5b274 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1566 microversion: 2.1 time: 0.155758 Jun 21 16:57:04.496464 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 428/876] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:04 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:04.672968 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-acf16c2a-a4f8-419d-990d-608e2af31645 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:04.673974 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-acf16c2a-a4f8-419d-990d-608e2af31645 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:04.692114 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acf16c2a-a4f8-419d-990d-608e2af31645 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:04.692679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acf16c2a-a4f8-419d-990d-608e2af31645 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:04.697118 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acf16c2a-a4f8-419d-990d-608e2af31645 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:04.697118 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acf16c2a-a4f8-419d-990d-608e2af31645 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:04.759878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-acf16c2a-a4f8-419d-990d-608e2af31645 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:04.767409 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-acf16c2a-a4f8-419d-990d-608e2af31645 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1215 microversion: 2.1 time: 0.098979 Jun 21 16:57:04.767968 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 449/877] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:04 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:05.513835 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-643f666c-ec4e-4bf3-9cd7-fa37ea139d6a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:05.514532 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-643f666c-ec4e-4bf3-9cd7-fa37ea139d6a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:05.538070 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-643f666c-ec4e-4bf3-9cd7-fa37ea139d6a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:05.538780 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-643f666c-ec4e-4bf3-9cd7-fa37ea139d6a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:05.539661 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-643f666c-ec4e-4bf3-9cd7-fa37ea139d6a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:05.540201 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-643f666c-ec4e-4bf3-9cd7-fa37ea139d6a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:05.785666 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ccf670cd-1740-4c03-8116-0bfc1bef94bf tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:05.786392 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ccf670cd-1740-4c03-8116-0bfc1bef94bf tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:05.794375 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ccf670cd-1740-4c03-8116-0bfc1bef94bf tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:05.795087 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ccf670cd-1740-4c03-8116-0bfc1bef94bf tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:05.796736 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ccf670cd-1740-4c03-8116-0bfc1bef94bf tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:05.797376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ccf670cd-1740-4c03-8116-0bfc1bef94bf tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:05.811345 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-643f666c-ec4e-4bf3-9cd7-fa37ea139d6a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:05.824642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-643f666c-ec4e-4bf3-9cd7-fa37ea139d6a tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1447 microversion: 2.1 time: 0.314590 Jun 21 16:57:05.825536 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 429/878] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:05 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1447 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:05.879631 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ccf670cd-1740-4c03-8116-0bfc1bef94bf tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:05.888235 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ccf670cd-1740-4c03-8116-0bfc1bef94bf tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1279 microversion: 2.1 time: 0.106583 Jun 21 16:57:05.888789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 450/879] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:05 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1279 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:06.741803 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-d51fc06d-ec5f-4653-91a3-a5581b60fcfe req-10f93b4e-9884-4bf6-b390-bbb646d2130d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c7a8e0-22b7-46fd-8a39-03e153ce2dc4", "name": "network-vif-deleted", "tag": "abae0918-ee64-4a4d-89a7-fad9196b8160"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:06.752901 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-d51fc06d-ec5f-4653-91a3-a5581b60fcfe req-10f93b4e-9884-4bf6-b390-bbb646d2130d service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:06.753371 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-d51fc06d-ec5f-4653-91a3-a5581b60fcfe req-10f93b4e-9884-4bf6-b390-bbb646d2130d service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:06.766851 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-d51fc06d-ec5f-4653-91a3-a5581b60fcfe req-10f93b4e-9884-4bf6-b390-bbb646d2130d service nova] Creating event network-vif-deleted:abae0918-ee64-4a4d-89a7-fad9196b8160 for instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 on hv-cinder-79987 Jun 21 16:57:06.773726 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-d51fc06d-ec5f-4653-91a3-a5581b60fcfe req-10f93b4e-9884-4bf6-b390-bbb646d2130d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040907 Jun 21 16:57:06.774297 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 430/880] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:06.842773 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-588e3d30-ecad-42f0-8185-62fb15284562 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:06.844418 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-588e3d30-ecad-42f0-8185-62fb15284562 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:06.852280 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-588e3d30-ecad-42f0-8185-62fb15284562 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:06.852721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-588e3d30-ecad-42f0-8185-62fb15284562 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:06.853543 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-588e3d30-ecad-42f0-8185-62fb15284562 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:06.854355 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-588e3d30-ecad-42f0-8185-62fb15284562 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:06.906599 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-262c0568-876e-446e-9bfb-11f627a32b20 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:06.907373 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-262c0568-876e-446e-9bfb-11f627a32b20 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:06.914237 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-262c0568-876e-446e-9bfb-11f627a32b20 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:06.914820 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-262c0568-876e-446e-9bfb-11f627a32b20 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:06.915602 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-262c0568-876e-446e-9bfb-11f627a32b20 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:06.916035 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-262c0568-876e-446e-9bfb-11f627a32b20 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:06.930505 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-588e3d30-ecad-42f0-8185-62fb15284562 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:06.939724 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-588e3d30-ecad-42f0-8185-62fb15284562 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1379 microversion: 2.1 time: 0.100988 Jun 21 16:57:06.941044 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 451/881] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:06 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1379 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:07.026511 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-262c0568-876e-446e-9bfb-11f627a32b20 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:07.035626 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-262c0568-876e-446e-9bfb-11f627a32b20 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1277 microversion: 2.1 time: 0.133524 Jun 21 16:57:07.037069 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 431/882] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:06 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:07.958534 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:07.960796 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:07.967876 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:07.968584 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:07.969760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:07.970344 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:08.005712 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:08.006532 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:08.007122 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lazy-loading 'fault' on Instance uuid 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:57:08.054217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f9433f9a-8712-422a-b08c-cc7572a3fa17 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:08.055083 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da333ac86414ffd9661dbd15594e736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab25929bbd643a68f0f01f1fb22b292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:08.055461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f9433f9a-8712-422a-b08c-cc7572a3fa17 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:08.064857 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2e435916-16cc-46d4-84c0-7c4da25c4e44 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 200 len: 1222 microversion: 2.1 time: 0.110067 Jun 21 16:57:08.065470 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 452/883] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:07 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:08.077882 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9433f9a-8712-422a-b08c-cc7572a3fa17 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:08.078335 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9433f9a-8712-422a-b08c-cc7572a3fa17 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:08.081375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9433f9a-8712-422a-b08c-cc7572a3fa17 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:08.081375 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f9433f9a-8712-422a-b08c-cc7572a3fa17 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:08.222544 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f9433f9a-8712-422a-b08c-cc7572a3fa17 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:08.231686 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f9433f9a-8712-422a-b08c-cc7572a3fa17 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1319 microversion: 2.1 time: 0.182058 Jun 21 16:57:08.232975 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 432/884] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:08 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:08.808859 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-901e6002-d254-4fe8-99d1-abeacb65fdb9 req-08735942-8465-4e32-b200-7117eca71320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9ed311-c5b6-495a-b6d7-ac929d95d8b2", "tag": "28c431e8-c7c1-48ff-b319-2da54d99e5d4"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:08.820037 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-901e6002-d254-4fe8-99d1-abeacb65fdb9 req-08735942-8465-4e32-b200-7117eca71320 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:08.820584 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-901e6002-d254-4fe8-99d1-abeacb65fdb9 req-08735942-8465-4e32-b200-7117eca71320 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:08.834112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-901e6002-d254-4fe8-99d1-abeacb65fdb9 req-08735942-8465-4e32-b200-7117eca71320 service nova] Creating event network-changed:28c431e8-c7c1-48ff-b319-2da54d99e5d4 for instance 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 on hv-cinder-79987 Jun 21 16:57:08.843021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-901e6002-d254-4fe8-99d1-abeacb65fdb9 req-08735942-8465-4e32-b200-7117eca71320 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038002 Jun 21 16:57:08.846346 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 453/885] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:57:09.089265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:09.089956 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] [instance: 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:09.096633 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:09.097088 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:09.097891 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:09.098332 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:09.113808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] HTTP exception thrown: Instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 could not be found. Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Request method failure captured: Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 HTTP/1.1 Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfcRDTnXd6gqu_oIjW3Qa1SUUdcMN034Iu8CBu41bqpYjXcVlP7UX1hJri0Oaf1DbyJ9dOT321R63u6tIRo-dmVs9CPdPDBJFep1uGC59t4yVY5cMuLSVfcWWavwaIp2avX14AYkswBzbQjvhERUG9feqCiCHH_wt7lLZ6AJzTZt3bs Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 7ab25929bbd643a68f0f01f1fb22b292 Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-TestShelveInstance-827416836 Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:57:09.114288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7ab25929bbd643a68f0f01f1fb22b292"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7ab25929bbd643a68f0f01f1fb22b292"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7ab25929bbd643a68f0f01f1fb22b292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7ab25929bbd643a68f0f01f1fb22b292", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-TestShelveInstance-827416836 Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 7ab25929bbd643a68f0f01f1fb22b292 Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-TestShelveInstance-827416836 Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-TestShelveInstance-827416836-project Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 1da333ac86414ffd9661dbd15594e736 Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-TestShelveInstance-827416836-project Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 could not be found. Jun 21 16:57:09.116476 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '71c7a8e0-22b7-46fd-8a39-03e153ce2dc4'} Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 could not be found. Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:57:09.117969 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 could not be found. Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 could not be found. Jun 21 16:57:09.119499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:09.121605 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Returning 404 to user: Instance 71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:57:09.121605 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5e8864da-b422-49bc-a492-f226830584cf tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4" status: 404 len: 111 microversion: 2.1 time: 0.031293 Jun 21 16:57:09.121605 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 433/886] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:09 2022] GET /compute/v2.1/servers/71c7a8e0-22b7-46fd-8a39-03e153ce2dc4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:57:09.250625 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-64ba750f-636d-49bd-a4b2-7621bca7d7d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:09.257239 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-64ba750f-636d-49bd-a4b2-7621bca7d7d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:09.259166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-64ba750f-636d-49bd-a4b2-7621bca7d7d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:09.259822 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-64ba750f-636d-49bd-a4b2-7621bca7d7d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:09.260626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-64ba750f-636d-49bd-a4b2-7621bca7d7d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:09.261064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-64ba750f-636d-49bd-a4b2-7621bca7d7d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:09.420364 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-984369f2-9091-45ea-aac6-f3856b01f747 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] Calling method '.version_select at 0x7f0a42a3a700>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:09.438604 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-64ba750f-636d-49bd-a4b2-7621bca7d7d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:09.451878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-64ba750f-636d-49bd-a4b2-7621bca7d7d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1319 microversion: 2.1 time: 0.204865 Jun 21 16:57:09.465766 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 454/887] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:09 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:09.496286 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-984369f2-9091-45ea-aac6-f3856b01f747 tempest-TestShelveInstance-827416836 tempest-TestShelveInstance-827416836-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-39343384" status: 202 len: 0 microversion: 2.1 time: 0.078663 Jun 21 16:57:09.497063 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 434/888] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:57:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-39343384 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:57:10.469243 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a2818c63-de07-4a26-ab49-c79ed428188a tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:10.469954 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a2818c63-de07-4a26-ab49-c79ed428188a tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:10.476876 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2818c63-de07-4a26-ab49-c79ed428188a tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:10.478021 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2818c63-de07-4a26-ab49-c79ed428188a tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:10.478146 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2818c63-de07-4a26-ab49-c79ed428188a tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:10.478576 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2818c63-de07-4a26-ab49-c79ed428188a tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:10.643300 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a2818c63-de07-4a26-ab49-c79ed428188a tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:10.653324 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a2818c63-de07-4a26-ab49-c79ed428188a tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1319 microversion: 2.1 time: 0.188045 Jun 21 16:57:10.654051 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 455/889] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:10 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:11.671108 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ab9fa78a-4ad7-4efa-be79-cfd84d7b1a3b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:11.672971 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ab9fa78a-4ad7-4efa-be79-cfd84d7b1a3b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:11.679701 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:11.681782 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ab9fa78a-4ad7-4efa-be79-cfd84d7b1a3b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:11.682688 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ab9fa78a-4ad7-4efa-be79-cfd84d7b1a3b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:11.683700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ab9fa78a-4ad7-4efa-be79-cfd84d7b1a3b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:11.684350 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ab9fa78a-4ad7-4efa-be79-cfd84d7b1a3b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:11.832351 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ab9fa78a-4ad7-4efa-be79-cfd84d7b1a3b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:11.842970 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ab9fa78a-4ad7-4efa-be79-cfd84d7b1a3b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1319 microversion: 2.1 time: 0.175733 Jun 21 16:57:11.843542 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 435/890] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:11 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:12.860238 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-77e172e9-783b-49ef-a7f1-fb9d47ef8ec2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:12.860827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-77e172e9-783b-49ef-a7f1-fb9d47ef8ec2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:12.862918 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:12.868614 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-77e172e9-783b-49ef-a7f1-fb9d47ef8ec2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:12.872605 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-77e172e9-783b-49ef-a7f1-fb9d47ef8ec2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:12.872605 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-77e172e9-783b-49ef-a7f1-fb9d47ef8ec2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:12.872605 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-77e172e9-783b-49ef-a7f1-fb9d47ef8ec2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:13.064878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-77e172e9-783b-49ef-a7f1-fb9d47ef8ec2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:13.076926 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-77e172e9-783b-49ef-a7f1-fb9d47ef8ec2 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1319 microversion: 2.1 time: 0.218518 Jun 21 16:57:13.077937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 456/891] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:12 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:13.718433 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-b664749c-0eae-41d6-b5e6-4e997eec1f99 req-7e243ef5-b162-4cf8-b806-1a848f5ef136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9ed311-c5b6-495a-b6d7-ac929d95d8b2", "name": "network-vif-plugged", "status": "completed", "tag": "28c431e8-c7c1-48ff-b319-2da54d99e5d4"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:13.721927 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=8 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:13.737238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-b664749c-0eae-41d6-b5e6-4e997eec1f99 req-7e243ef5-b162-4cf8-b806-1a848f5ef136 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:13.737721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-b664749c-0eae-41d6-b5e6-4e997eec1f99 req-7e243ef5-b162-4cf8-b806-1a848f5ef136 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:13.764693 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-b664749c-0eae-41d6-b5e6-4e997eec1f99 req-7e243ef5-b162-4cf8-b806-1a848f5ef136 service nova] Creating event network-vif-plugged:28c431e8-c7c1-48ff-b319-2da54d99e5d4 for instance 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 on hv-cinder-79987 Jun 21 16:57:13.797677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-b664749c-0eae-41d6-b5e6-4e997eec1f99 req-7e243ef5-b162-4cf8-b806-1a848f5ef136 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080607 Jun 21 16:57:13.797677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 436/892] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:14.096787 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a9209bb7-787c-4c9b-b09f-0447c3af8f92 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:14.097462 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a9209bb7-787c-4c9b-b09f-0447c3af8f92 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:14.115177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a9209bb7-787c-4c9b-b09f-0447c3af8f92 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:14.116370 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a9209bb7-787c-4c9b-b09f-0447c3af8f92 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:14.117153 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a9209bb7-787c-4c9b-b09f-0447c3af8f92 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:14.117615 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a9209bb7-787c-4c9b-b09f-0447c3af8f92 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:14.273413 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a9209bb7-787c-4c9b-b09f-0447c3af8f92 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:14.281208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a9209bb7-787c-4c9b-b09f-0447c3af8f92 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1319 microversion: 2.1 time: 0.188694 Jun 21 16:57:14.281808 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 457/893] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:14 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:15.304936 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c223f2e6-f8f6-4369-8158-bbe737131d8e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:15.306766 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c223f2e6-f8f6-4369-8158-bbe737131d8e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:15.316181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c223f2e6-f8f6-4369-8158-bbe737131d8e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:15.316865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c223f2e6-f8f6-4369-8158-bbe737131d8e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:15.317697 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c223f2e6-f8f6-4369-8158-bbe737131d8e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:15.318740 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c223f2e6-f8f6-4369-8158-bbe737131d8e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:15.554127 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-c223f2e6-f8f6-4369-8158-bbe737131d8e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:15.561648 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c223f2e6-f8f6-4369-8158-bbe737131d8e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1319 microversion: 2.1 time: 0.265596 Jun 21 16:57:15.562223 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 437/894] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:15 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:16.579183 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-34eb7e1b-3836-4e4f-a7cc-31f50fa18128 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:16.579710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-34eb7e1b-3836-4e4f-a7cc-31f50fa18128 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:16.587454 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34eb7e1b-3836-4e4f-a7cc-31f50fa18128 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:16.594744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34eb7e1b-3836-4e4f-a7cc-31f50fa18128 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:16.594744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34eb7e1b-3836-4e4f-a7cc-31f50fa18128 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:16.594744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34eb7e1b-3836-4e4f-a7cc-31f50fa18128 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:16.750265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-34eb7e1b-3836-4e4f-a7cc-31f50fa18128 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:16.759501 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-34eb7e1b-3836-4e4f-a7cc-31f50fa18128 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1508 microversion: 2.1 time: 0.184201 Jun 21 16:57:16.760205 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 458/895] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:16 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:18.017736 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-886843e2-85f0-46f2-9bac-2fccee96cf10 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:18.018327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-886843e2-85f0-46f2-9bac-2fccee96cf10 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:18.030396 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-886843e2-85f0-46f2-9bac-2fccee96cf10 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:18.031406 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-886843e2-85f0-46f2-9bac-2fccee96cf10 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:18.032200 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-886843e2-85f0-46f2-9bac-2fccee96cf10 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:18.033121 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-886843e2-85f0-46f2-9bac-2fccee96cf10 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:18.070834 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-886843e2-85f0-46f2-9bac-2fccee96cf10 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c/ips" status: 200 len: 150 microversion: 2.1 time: 0.057540 Jun 21 16:57:18.071502 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 438/896] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:57:18 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:18.082495 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1034dd9c-ebe2-4210-aea5-148ab2e5af3f"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:18.084710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:18.091712 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:18.092156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:18.093006 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:18.093518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:18.191978 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Invalid volume: volume 1034dd9c-ebe2-4210-aea5-148ab2e5af3f is already attached to instances: 1c19e657-0d31-410a-b755-4e2d41c926d6 Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: POST /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c/os-volume_attachments HTTP/1.1 Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 74 Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:57:18.194328 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {"volumeAttachment": {"volumeId": "1034dd9c-ebe2-4210-aea5-148ab2e5af3f"}} Jun 21 16:57:18.196000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Invalid volume: volume 1034dd9c-ebe2-4210-aea5-148ab2e5af3f is already attached to instances: 1c19e657-0d31-410a-b755-4e2d41c926d6 Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'server_id': '5e0967ec-4512-4953-8d0c-cd5c2616341c', 'body': {'volumeAttachment': {'volumeId': '1034dd9c-ebe2-4210-aea5-148ab2e5af3f'}}} Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1034dd9c-ebe2-4210-aea5-148ab2e5af3f is already attached to instances: 1c19e657-0d31-410a-b755-4e2d41c926d6 Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:18.196947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1034dd9c-ebe2-4210-aea5-148ab2e5af3f is already attached to instances: 1c19e657-0d31-410a-b755-4e2d41c926d6 Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:18.198288 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:57:18.199875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:57:18.199875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:57:18.199875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:57:18.199875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1034dd9c-ebe2-4210-aea5-148ab2e5af3f is already attached to instances: 1c19e657-0d31-410a-b755-4e2d41c926d6 Jun 21 16:57:18.199875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:18.199875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 400 to user: Invalid volume: volume 1034dd9c-ebe2-4210-aea5-148ab2e5af3f is already attached to instances: 1c19e657-0d31-410a-b755-4e2d41c926d6 {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:57:18.199875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-70544111-2305-496b-abda-cc354ea34a9c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120389 Jun 21 16:57:18.200877 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 459/897] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:57:18 2022] POST /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 21 16:57:18.218784 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-99d0adf1-e28b-419a-9190-1edb04001cb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:18.219908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-99d0adf1-e28b-419a-9190-1edb04001cb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:18.229533 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-99d0adf1-e28b-419a-9190-1edb04001cb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:18.230892 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-99d0adf1-e28b-419a-9190-1edb04001cb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:18.244594 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-99d0adf1-e28b-419a-9190-1edb04001cb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:18.245301 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-99d0adf1-e28b-419a-9190-1edb04001cb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:18.275931 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-99d0adf1-e28b-419a-9190-1edb04001cb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:57:18.825982 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-99d0adf1-e28b-419a-9190-1edb04001cb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 204 len: 0 microversion: 2.1 time: 0.613255 Jun 21 16:57:18.826949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 439/898] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:57:18 2022] DELETE /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:57:18.836369 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-516d9c1c-fd6c-4723-892c-95507d3130fc tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:18.836973 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-516d9c1c-fd6c-4723-892c-95507d3130fc tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:18.844342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-516d9c1c-fd6c-4723-892c-95507d3130fc tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:18.844342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-516d9c1c-fd6c-4723-892c-95507d3130fc tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:18.844342 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-516d9c1c-fd6c-4723-892c-95507d3130fc tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:18.844673 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-516d9c1c-fd6c-4723-892c-95507d3130fc tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:18.990419 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-516d9c1c-fd6c-4723-892c-95507d3130fc tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:18.999561 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-516d9c1c-fd6c-4723-892c-95507d3130fc tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1681 microversion: 2.1 time: 0.167463 Jun 21 16:57:19.000204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 460/899] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:18 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:20.018035 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-65b1501b-6156-4166-b6a8-b4bf4c4e75d5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:20.018876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-65b1501b-6156-4166-b6a8-b4bf4c4e75d5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:20.026260 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-65b1501b-6156-4166-b6a8-b4bf4c4e75d5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:20.026706 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-65b1501b-6156-4166-b6a8-b4bf4c4e75d5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:20.027459 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-65b1501b-6156-4166-b6a8-b4bf4c4e75d5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:20.027923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-65b1501b-6156-4166-b6a8-b4bf4c4e75d5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:20.194198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-65b1501b-6156-4166-b6a8-b4bf4c4e75d5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:20.194198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-65b1501b-6156-4166-b6a8-b4bf4c4e75d5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1681 microversion: 2.1 time: 0.179821 Jun 21 16:57:20.194606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 440/900] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:20 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:21.218501 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-34a52a67-9915-42a2-8895-90a511e0eafe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:21.219900 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-34a52a67-9915-42a2-8895-90a511e0eafe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:21.229728 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34a52a67-9915-42a2-8895-90a511e0eafe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:21.230676 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34a52a67-9915-42a2-8895-90a511e0eafe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:21.232193 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34a52a67-9915-42a2-8895-90a511e0eafe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:21.233000 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-34a52a67-9915-42a2-8895-90a511e0eafe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:21.313436 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-34a52a67-9915-42a2-8895-90a511e0eafe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:21.321253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-34a52a67-9915-42a2-8895-90a511e0eafe tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1613 microversion: 2.1 time: 0.110011 Jun 21 16:57:21.321846 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 461/901] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:21 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1613 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:21.437651 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-82ae257a-6dbb-480c-8ef1-0d623d95be5f req-130b297b-5804-46fa-84b4-67e9f9d79a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0967ec-4512-4953-8d0c-cd5c2616341c", "name": "network-vif-deleted", "tag": "7cb6c36c-9757-4544-9b68-2781176ab5c4"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:21.448216 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-82ae257a-6dbb-480c-8ef1-0d623d95be5f req-130b297b-5804-46fa-84b4-67e9f9d79a3c service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:21.448650 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-82ae257a-6dbb-480c-8ef1-0d623d95be5f req-130b297b-5804-46fa-84b4-67e9f9d79a3c service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:21.620614 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-82ae257a-6dbb-480c-8ef1-0d623d95be5f req-130b297b-5804-46fa-84b4-67e9f9d79a3c service nova] Creating event network-vif-deleted:7cb6c36c-9757-4544-9b68-2781176ab5c4 for instance 5e0967ec-4512-4953-8d0c-cd5c2616341c on hv-cinder-79987 Jun 21 16:57:21.625905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-82ae257a-6dbb-480c-8ef1-0d623d95be5f req-130b297b-5804-46fa-84b4-67e9f9d79a3c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191750 Jun 21 16:57:21.626658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 441/902] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:22.340832 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:22.342151 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:22.349048 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:22.350609 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:22.351685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:22.352116 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:22.356695 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:22.389074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:22.389777 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:22.394479 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lazy-loading 'fault' on Instance uuid 5e0967ec-4512-4953-8d0c-cd5c2616341c {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:57:22.443545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:22.452436 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-379101e9-cdea-4d9b-a5d5-3092b80da052 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 200 len: 1330 microversion: 2.1 time: 0.115870 Jun 21 16:57:22.453453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 462/903] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:22 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:23.471183 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:23.472111 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:23.480400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:23.480847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:23.481660 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:23.482091 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:23.497496 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c HTTP/1.1 Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:57:23.499181 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 16:57:23.500838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '5e0967ec-4512-4953-8d0c-cd5c2616341c'} Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:57:23.501926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 16:57:23.503455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:57:23.504847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:57:23.504847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-eb81df20-c9af-4434-9bcc-3602b1497139 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 404 len: 111 microversion: 2.1 time: 0.034179 Jun 21 16:57:23.504847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 442/904] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:23 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:57:23.510959 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-20bc3caa-2e10-4a9b-88a7-a80e3f0268e9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '.version_select at 0x7f0a42a30d30>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:23.687980 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-20bc3caa-2e10-4a9b-88a7-a80e3f0268e9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-190833479" status: 202 len: 0 microversion: 2.1 time: 0.182002 Jun 21 16:57:23.688626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 463/905] 10.222.0.70 () {58 vars in 1217 bytes} [Tue Jun 21 16:57:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-190833479 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:57:24.651861 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b5b93b4f-2852-4bcc-a6a3-8f2e053f3da4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:24.652498 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b5b93b4f-2852-4bcc-a6a3-8f2e053f3da4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:24.659009 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b5b93b4f-2852-4bcc-a6a3-8f2e053f3da4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:24.659454 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b5b93b4f-2852-4bcc-a6a3-8f2e053f3da4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:24.660209 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b5b93b4f-2852-4bcc-a6a3-8f2e053f3da4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:24.660643 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b5b93b4f-2852-4bcc-a6a3-8f2e053f3da4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:24.744844 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-b5b93b4f-2852-4bcc-a6a3-8f2e053f3da4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lazy-loading 'services' on Instance uuid 1c19e657-0d31-410a-b755-4e2d41c926d6 {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:57:24.977914 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b5b93b4f-2852-4bcc-a6a3-8f2e053f3da4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments/1034dd9c-ebe2-4210-aea5-148ab2e5af3f" status: 202 len: 0 microversion: 2.1 time: 0.329774 Jun 21 16:57:24.978589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 443/906] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 16:57:24 2022] DELETE /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments/1034dd9c-ebe2-4210-aea5-148ab2e5af3f => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:57:24.996471 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f5d17008-dd0f-405a-8c34-4dd12da4f296 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:24.998459 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f5d17008-dd0f-405a-8c34-4dd12da4f296 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:25.011635 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f5d17008-dd0f-405a-8c34-4dd12da4f296 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:25.012090 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f5d17008-dd0f-405a-8c34-4dd12da4f296 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:25.012871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f5d17008-dd0f-405a-8c34-4dd12da4f296 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:25.017791 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f5d17008-dd0f-405a-8c34-4dd12da4f296 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:25.046014 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f5d17008-dd0f-405a-8c34-4dd12da4f296 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054224 Jun 21 16:57:25.046586 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 464/907] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:57:24 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:26.060087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-82ac4a18-25ec-4a3e-89e9-375f44fde0a5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:26.060715 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-82ac4a18-25ec-4a3e-89e9-375f44fde0a5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:26.067082 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-82ac4a18-25ec-4a3e-89e9-375f44fde0a5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:26.067547 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-82ac4a18-25ec-4a3e-89e9-375f44fde0a5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:26.068310 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-82ac4a18-25ec-4a3e-89e9-375f44fde0a5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:26.068806 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-82ac4a18-25ec-4a3e-89e9-375f44fde0a5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:26.098252 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-82ac4a18-25ec-4a3e-89e9-375f44fde0a5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043465 Jun 21 16:57:26.098816 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 444/908] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:57:26 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:27.111355 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-078ab40b-0143-4837-8e97-3a29ab1a8d9d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:27.112264 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-078ab40b-0143-4837-8e97-3a29ab1a8d9d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:27.122541 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-078ab40b-0143-4837-8e97-3a29ab1a8d9d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:27.122541 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-078ab40b-0143-4837-8e97-3a29ab1a8d9d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:27.122541 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-078ab40b-0143-4837-8e97-3a29ab1a8d9d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:27.122541 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-078ab40b-0143-4837-8e97-3a29ab1a8d9d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:27.156818 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-078ab40b-0143-4837-8e97-3a29ab1a8d9d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049685 Jun 21 16:57:27.160584 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 465/909] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:57:27 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:28.168979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-356ffcde-d45c-419f-a31d-27b745870686 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:28.169883 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-356ffcde-d45c-419f-a31d-27b745870686 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:28.176372 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-356ffcde-d45c-419f-a31d-27b745870686 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:28.176821 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-356ffcde-d45c-419f-a31d-27b745870686 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:28.177715 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-356ffcde-d45c-419f-a31d-27b745870686 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:28.178046 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-356ffcde-d45c-419f-a31d-27b745870686 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:28.182871 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:28.209217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-356ffcde-d45c-419f-a31d-27b745870686 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044335 Jun 21 16:57:28.210148 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 445/910] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:57:28 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:57:28.277808 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-393f2ec8-d271-41c8-801b-ac4110f4a183 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:28.278338 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-393f2ec8-d271-41c8-801b-ac4110f4a183 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:28.284765 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-393f2ec8-d271-41c8-801b-ac4110f4a183 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:28.285489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-393f2ec8-d271-41c8-801b-ac4110f4a183 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:28.286377 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-393f2ec8-d271-41c8-801b-ac4110f4a183 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:28.287013 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-393f2ec8-d271-41c8-801b-ac4110f4a183 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:28.315814 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-393f2ec8-d271-41c8-801b-ac4110f4a183 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Going to try to terminate instance {{(pid=124685) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:57:28.829491 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-393f2ec8-d271-41c8-801b-ac4110f4a183 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 204 len: 0 microversion: 2.1 time: 0.556940 Jun 21 16:57:28.830136 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 466/911] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:57:28 2022] DELETE /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:57:28.840273 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-99520718-f634-49a1-8d48-0a2578194e0e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:28.840879 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-99520718-f634-49a1-8d48-0a2578194e0e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:28.847867 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-99520718-f634-49a1-8d48-0a2578194e0e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:28.848313 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-99520718-f634-49a1-8d48-0a2578194e0e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:28.849067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-99520718-f634-49a1-8d48-0a2578194e0e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:28.849555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-99520718-f634-49a1-8d48-0a2578194e0e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:28.994438 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-99520718-f634-49a1-8d48-0a2578194e0e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:29.002061 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-99520718-f634-49a1-8d48-0a2578194e0e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1684 microversion: 2.1 time: 0.167560 Jun 21 16:57:29.004451 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 446/912] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:28 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:30.020533 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-faec9ae3-ec4d-48d0-a880-4e34bf13e307 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:30.021235 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-faec9ae3-ec4d-48d0-a880-4e34bf13e307 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:30.029312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-faec9ae3-ec4d-48d0-a880-4e34bf13e307 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:30.029780 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-faec9ae3-ec4d-48d0-a880-4e34bf13e307 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:30.030558 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-faec9ae3-ec4d-48d0-a880-4e34bf13e307 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:30.030997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-faec9ae3-ec4d-48d0-a880-4e34bf13e307 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:30.170964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-faec9ae3-ec4d-48d0-a880-4e34bf13e307 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:30.179168 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-faec9ae3-ec4d-48d0-a880-4e34bf13e307 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1684 microversion: 2.1 time: 0.162709 Jun 21 16:57:30.179805 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 467/913] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:30 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:31.197775 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-316afd2c-be9d-4740-a181-2c8e6dae96a1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:31.198461 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-316afd2c-be9d-4740-a181-2c8e6dae96a1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:31.201151 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:31.206408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-316afd2c-be9d-4740-a181-2c8e6dae96a1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:31.206846 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-316afd2c-be9d-4740-a181-2c8e6dae96a1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:31.207592 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-316afd2c-be9d-4740-a181-2c8e6dae96a1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:31.208015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-316afd2c-be9d-4740-a181-2c8e6dae96a1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:31.344150 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-316afd2c-be9d-4740-a181-2c8e6dae96a1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:31.352755 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-316afd2c-be9d-4740-a181-2c8e6dae96a1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1684 microversion: 2.1 time: 0.159616 Jun 21 16:57:31.353340 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 447/914] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:31 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:32.370937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-efb5adbf-d404-475e-a40d-9d589c1cef70 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:32.371545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-efb5adbf-d404-475e-a40d-9d589c1cef70 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:32.378279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-efb5adbf-d404-475e-a40d-9d589c1cef70 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:32.378747 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-efb5adbf-d404-475e-a40d-9d589c1cef70 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:32.379510 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-efb5adbf-d404-475e-a40d-9d589c1cef70 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:32.379947 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-efb5adbf-d404-475e-a40d-9d589c1cef70 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:32.515419 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-efb5adbf-d404-475e-a40d-9d589c1cef70 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:32.522996 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-efb5adbf-d404-475e-a40d-9d589c1cef70 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1684 microversion: 2.1 time: 0.156812 Jun 21 16:57:32.523529 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 468/915] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:32 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:33.542069 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6ea23cfd-cd04-46a1-a672-45b1bd68248d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:33.542727 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6ea23cfd-cd04-46a1-a672-45b1bd68248d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:33.549636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6ea23cfd-cd04-46a1-a672-45b1bd68248d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:33.550092 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6ea23cfd-cd04-46a1-a672-45b1bd68248d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:33.550867 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6ea23cfd-cd04-46a1-a672-45b1bd68248d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:33.551296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6ea23cfd-cd04-46a1-a672-45b1bd68248d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:33.689074 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6ea23cfd-cd04-46a1-a672-45b1bd68248d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:33.698328 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6ea23cfd-cd04-46a1-a672-45b1bd68248d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1684 microversion: 2.1 time: 0.160268 Jun 21 16:57:33.699328 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 448/916] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:33 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:34.716620 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c57448ea-e93b-424f-8999-5e6a0125dba0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:34.717234 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c57448ea-e93b-424f-8999-5e6a0125dba0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:34.720954 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:34.725024 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c57448ea-e93b-424f-8999-5e6a0125dba0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:34.725489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c57448ea-e93b-424f-8999-5e6a0125dba0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:34.726263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c57448ea-e93b-424f-8999-5e6a0125dba0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:34.726702 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c57448ea-e93b-424f-8999-5e6a0125dba0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:34.872733 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c57448ea-e93b-424f-8999-5e6a0125dba0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:34.880571 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c57448ea-e93b-424f-8999-5e6a0125dba0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1684 microversion: 2.1 time: 0.168535 Jun 21 16:57:34.881433 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 469/917] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:34 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:35.249501 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-77168241-eaeb-4bc9-855d-944a82fee316 req-6f9fe8f4-d680-4297-a63a-9db11690b377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c19e657-0d31-410a-b755-4e2d41c926d6", "name": "network-vif-deleted", "tag": "10e929cc-6721-4663-927d-8eb4ca2d862b"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:35.258430 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-77168241-eaeb-4bc9-855d-944a82fee316 req-6f9fe8f4-d680-4297-a63a-9db11690b377 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:35.258871 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-77168241-eaeb-4bc9-855d-944a82fee316 req-6f9fe8f4-d680-4297-a63a-9db11690b377 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:35.279138 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-77168241-eaeb-4bc9-855d-944a82fee316 req-6f9fe8f4-d680-4297-a63a-9db11690b377 service nova] Creating event network-vif-deleted:10e929cc-6721-4663-927d-8eb4ca2d862b for instance 1c19e657-0d31-410a-b755-4e2d41c926d6 on hv-cinder-79987 Jun 21 16:57:35.284139 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-77168241-eaeb-4bc9-855d-944a82fee316 req-6f9fe8f4-d680-4297-a63a-9db11690b377 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038329 Jun 21 16:57:35.284721 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 449/918] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:35.897919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:35.898531 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:35.917422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:35.917932 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:35.920207 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:35.920653 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:35.963500 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:35.964209 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:35.964819 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lazy-loading 'fault' on Instance uuid 1c19e657-0d31-410a-b755-4e2d41c926d6 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:57:36.018618 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:36.026454 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-be2bf007-7a8e-4ec3-8cae-0888a2a05723 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 200 len: 1332 microversion: 2.1 time: 0.132551 Jun 21 16:57:36.027287 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 470/919] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:35 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:36.076714 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1491327630", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1039709549", "security_groups": [{"name": "tempest-secgroup-smoke-254481239"}], "block_device_mapping_v2": [{"uuid": "0ca0627d-4700-4876-a1a6-53a4f7e90357", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c20083da-e0ff-47bb-b753-e54f100e0a6f"}]}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:36.220838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.network.neutron [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] validate_networks() for [('c20083da-e0ff-47bb-b753-e54f100e0a6f', None, None, None, None, None)] {{(pid=124686) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:57:36.656498 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Flavor limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:57:36.657094 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Image limits 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:57:36.657422 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Flavor pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:57:36.657995 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Image pref 0:0:0 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:57:36.662298 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.virt.hardware [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124686) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:57:36.669410 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:36.671145 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:36.672068 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:36.672541 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:36.690369 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Getting quotas for project 7a8a0ae0c16a41c8b34547406830813a. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:57:36.694626 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Getting quotas for user 0ebe6382afe24ef489261081e8610271 and project 7a8a0ae0c16a41c8b34547406830813a. Resources: {'cores', 'instances', 'ram'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:57:36.758132 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Going to run 1 instances... {{(pid=124686) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:57:36.760531 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ca0627d-4700-4876-a1a6-53a4f7e90357',volume_size=None,volume_type=None)] {{(pid=124686) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:57:37.044980 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:37.046418 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:37.052451 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:37.052906 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:37.053703 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:37.054140 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:37.067705 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 HTTP/1.1 Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:57:37.069437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 16:57:37.071312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '1c19e657-0d31-410a-b755-4e2d41c926d6'} Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:57:37.072945 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 16:57:37.074981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:57:37.076544 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:57:37.076544 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-978de4fb-5a24-4d3b-b09d-61b126178085 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 404 len: 111 microversion: 2.1 time: 0.031041 Jun 21 16:57:37.076544 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 471/920] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:37 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 16:57:37.117447 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f52cae44-aab2-497d-b26e-1726025fd53e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '.version_select at 0x7f0a42b30040>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:37.327898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f52cae44-aab2-497d-b26e-1726025fd53e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576838783" status: 202 len: 0 microversion: 2.1 time: 0.214557 Jun 21 16:57:37.328394 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 472/921] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jun 21 16:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576838783 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 16:57:37.411439 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9332c4d5-c6e9-4155-af1f-52d14d98d812 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.340203 Jun 21 16:57:37.412112 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 450/922] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:57:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:57:37.422657 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8f0b7424-83eb-49d2-9fe7-7e4af3b16c1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:37.423266 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8f0b7424-83eb-49d2-9fe7-7e4af3b16c1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:37.484563 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8f0b7424-83eb-49d2-9fe7-7e4af3b16c1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:37.491853 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8f0b7424-83eb-49d2-9fe7-7e4af3b16c1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1095 microversion: 2.1 time: 0.073337 Jun 21 16:57:37.492152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 473/923] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:37 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:38.428304 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4f9f38f9-bb79-4548-b131-4d2850f1a493 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: .version_select at 0x7f0a429e2f70>, body: {"keypair": {"name": "tempest-keypair-497487434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuYLFSswxwUFDHrBiRK0R+SN33JrJuPVh6P9Uv+SonLX4fzWv8BZfCG8mAC3DlD5UdM4KXXx49bQjM7dPhsC4nIsZ3h18dM97URGcWNv1yV/E56F0ZboKPtsrLMJq6hlQ=="}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:38.445205 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-4f9f38f9-bb79-4548-b131-4d2850f1a493 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:57:38.449122 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-4f9f38f9-bb79-4548-b131-4d2850f1a493 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for user 8d1c7f32f0624210ae0ba52c022fea5a and project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:57:38.509701 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5d660731-761c-44c3-91e9-7c2a32ac2199 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:38.510312 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5d660731-761c-44c3-91e9-7c2a32ac2199 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:38.517504 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5d660731-761c-44c3-91e9-7c2a32ac2199 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:38.518094 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5d660731-761c-44c3-91e9-7c2a32ac2199 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:38.518869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5d660731-761c-44c3-91e9-7c2a32ac2199 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:38.519318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5d660731-761c-44c3-91e9-7c2a32ac2199 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:38.583862 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-5d660731-761c-44c3-91e9-7c2a32ac2199 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:38.591849 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5d660731-761c-44c3-91e9-7c2a32ac2199 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1145 microversion: 2.1 time: 0.086464 Jun 21 16:57:38.593550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 474/924] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:38 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:38.596571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4f9f38f9-bb79-4548-b131-4d2850f1a493 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.172521 Jun 21 16:57:38.597174 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 451/925] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 16:57:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:39.610174 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-71960171-a9ad-4c98-9224-95e488bddd5c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:39.610807 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-71960171-a9ad-4c98-9224-95e488bddd5c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:39.617751 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71960171-a9ad-4c98-9224-95e488bddd5c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:39.618207 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71960171-a9ad-4c98-9224-95e488bddd5c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:39.619439 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71960171-a9ad-4c98-9224-95e488bddd5c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:39.620595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-71960171-a9ad-4c98-9224-95e488bddd5c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:39.684146 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-71960171-a9ad-4c98-9224-95e488bddd5c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:39.691880 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-71960171-a9ad-4c98-9224-95e488bddd5c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1193 microversion: 2.1 time: 0.085572 Jun 21 16:57:39.692477 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 475/926] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:39 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:40.055750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0b1d3563-6a51-4162-bc33-b6b8a1c84d4e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4cb82f6-ff21-4729-942c-a10468e3ab4c", "device": "/dev/sdb"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:40.061957 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0b1d3563-6a51-4162-bc33-b6b8a1c84d4e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:40.084903 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b1d3563-6a51-4162-bc33-b6b8a1c84d4e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:40.090167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b1d3563-6a51-4162-bc33-b6b8a1c84d4e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:40.090167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b1d3563-6a51-4162-bc33-b6b8a1c84d4e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:40.090167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b1d3563-6a51-4162-bc33-b6b8a1c84d4e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:40.713267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9e15d0e2-f8a5-4637-b4af-cdbd14a88938 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:40.718937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9e15d0e2-f8a5-4637-b4af-cdbd14a88938 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:40.724059 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9e15d0e2-f8a5-4637-b4af-cdbd14a88938 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:40.724561 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9e15d0e2-f8a5-4637-b4af-cdbd14a88938 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:40.725768 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9e15d0e2-f8a5-4637-b4af-cdbd14a88938 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:40.726220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9e15d0e2-f8a5-4637-b4af-cdbd14a88938 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:40.822187 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9e15d0e2-f8a5-4637-b4af-cdbd14a88938 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:40.832117 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9e15d0e2-f8a5-4637-b4af-cdbd14a88938 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1211 microversion: 2.1 time: 0.125405 Jun 21 16:57:40.833079 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 476/927] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:40 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:41.058610 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0b1d3563-6a51-4162-bc33-b6b8a1c84d4e tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "POST /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.005779 Jun 21 16:57:41.062984 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 452/928] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:57:40 2022] POST /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2/os-volume_attachments => generated 194 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:41.634146 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1069631196", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83741c3b-7ff0-4b33-b398-e82b72fea3bd"}], "security_groups": [{"name": "tempest-securitygroup--1910728542"}], "key_name": "tempest-keypair-497487434", "user_data": "}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:41.778686 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] validate_networks() for [('83741c3b-7ff0-4b33-b398-e82b72fea3bd', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:57:41.853706 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-20668eb1-cd86-40fd-8027-64ef920a7ba6 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:41.855083 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-20668eb1-cd86-40fd-8027-64ef920a7ba6 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:41.862487 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-20668eb1-cd86-40fd-8027-64ef920a7ba6 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:41.862933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-20668eb1-cd86-40fd-8027-64ef920a7ba6 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:41.863689 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-20668eb1-cd86-40fd-8027-64ef920a7ba6 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:41.864114 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-20668eb1-cd86-40fd-8027-64ef920a7ba6 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:42.059553 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-20668eb1-cd86-40fd-8027-64ef920a7ba6 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:42.069115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-20668eb1-cd86-40fd-8027-64ef920a7ba6 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1278 microversion: 2.1 time: 0.220236 Jun 21 16:57:42.070020 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 453/929] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:41 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:42.220298 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:57:42.220729 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:57:42.221254 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:57:42.221685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:57:42.222223 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:57:42.232229 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:42.233014 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:42.234032 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:42.234730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:42.253698 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:57:42.257965 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for user 8d1c7f32f0624210ae0ba52c022fea5a and project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:57:42.270092 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:57:42.273687 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:57:42.403725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-577b37e9-45bf-44d9-ab6f-d8103fc83190 req-1ac3d00d-12b5-48e1-992d-7639fb29566e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc11023-ceb3-4f72-83d3-a4ea95eb2863", "tag": "711a0b2d-04b6-4f67-8f42-73102320e7af"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:42.406361 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a992a96d-0779-45f9-924a-017a444a5898 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.777091 Jun 21 16:57:42.407285 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 477/930] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:57:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:57:42.419128 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-577b37e9-45bf-44d9-ab6f-d8103fc83190 req-1ac3d00d-12b5-48e1-992d-7639fb29566e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:42.419573 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-577b37e9-45bf-44d9-ab6f-d8103fc83190 req-1ac3d00d-12b5-48e1-992d-7639fb29566e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:42.422619 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-07bedc85-ee4b-45cb-92f8-165c215bd8d2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:42.423323 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-07bedc85-ee4b-45cb-92f8-165c215bd8d2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:42.438845 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-577b37e9-45bf-44d9-ab6f-d8103fc83190 req-1ac3d00d-12b5-48e1-992d-7639fb29566e service nova] Creating event network-changed:711a0b2d-04b6-4f67-8f42-73102320e7af for instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 on hv-cinder-79987 Jun 21 16:57:42.456507 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-577b37e9-45bf-44d9-ab6f-d8103fc83190 req-1ac3d00d-12b5-48e1-992d-7639fb29566e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058956 Jun 21 16:57:42.458430 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 454/931] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:57:42.495067 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-07bedc85-ee4b-45cb-92f8-165c215bd8d2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:42.509234 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-07bedc85-ee4b-45cb-92f8-165c215bd8d2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1241 microversion: 2.1 time: 0.094854 Jun 21 16:57:42.509858 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 478/932] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:42 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:43.088004 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e358ef1a-4e16-4c68-84da-41623487b867 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:43.088836 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e358ef1a-4e16-4c68-84da-41623487b867 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:43.095395 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e358ef1a-4e16-4c68-84da-41623487b867 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:43.095838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e358ef1a-4e16-4c68-84da-41623487b867 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:43.096608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e358ef1a-4e16-4c68-84da-41623487b867 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:43.097040 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e358ef1a-4e16-4c68-84da-41623487b867 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:43.329933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e358ef1a-4e16-4c68-84da-41623487b867 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:43.337642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e358ef1a-4e16-4c68-84da-41623487b867 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.254333 Jun 21 16:57:43.338219 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 455/933] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:43 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:43.527840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-771a325c-4654-476e-94fa-71d6b36f7d79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:43.528573 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-771a325c-4654-476e-94fa-71d6b36f7d79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:43.535812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-771a325c-4654-476e-94fa-71d6b36f7d79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:43.536274 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-771a325c-4654-476e-94fa-71d6b36f7d79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:43.537052 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-771a325c-4654-476e-94fa-71d6b36f7d79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:43.537525 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-771a325c-4654-476e-94fa-71d6b36f7d79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:43.600462 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-771a325c-4654-476e-94fa-71d6b36f7d79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:43.608952 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-771a325c-4654-476e-94fa-71d6b36f7d79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1245 microversion: 2.1 time: 0.085961 Jun 21 16:57:43.609589 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 479/934] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:43 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:44.356294 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2db64ebe-826d-4ce2-992a-3007e982a94b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:44.356897 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2db64ebe-826d-4ce2-992a-3007e982a94b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:44.363489 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2db64ebe-826d-4ce2-992a-3007e982a94b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:44.367010 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2db64ebe-826d-4ce2-992a-3007e982a94b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:44.367010 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2db64ebe-826d-4ce2-992a-3007e982a94b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:44.367010 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2db64ebe-826d-4ce2-992a-3007e982a94b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:44.500957 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2db64ebe-826d-4ce2-992a-3007e982a94b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:44.508706 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2db64ebe-826d-4ce2-992a-3007e982a94b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.156908 Jun 21 16:57:44.509268 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 456/935] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:44 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:44.626422 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f6af7523-a858-43b7-a290-d82a20c517b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:44.627045 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f6af7523-a858-43b7-a290-d82a20c517b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:44.634361 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f6af7523-a858-43b7-a290-d82a20c517b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:44.634812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f6af7523-a858-43b7-a290-d82a20c517b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:44.635595 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f6af7523-a858-43b7-a290-d82a20c517b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:44.636030 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f6af7523-a858-43b7-a290-d82a20c517b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:44.711154 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f6af7523-a858-43b7-a290-d82a20c517b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:44.720626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f6af7523-a858-43b7-a290-d82a20c517b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1301 microversion: 2.1 time: 0.098626 Jun 21 16:57:44.721493 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 480/936] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:44 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:45.526446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b3dfb3dd-8d82-4d51-b839-f13a1a1aae86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:45.527638 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b3dfb3dd-8d82-4d51-b839-f13a1a1aae86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:45.534339 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3dfb3dd-8d82-4d51-b839-f13a1a1aae86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:45.534794 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3dfb3dd-8d82-4d51-b839-f13a1a1aae86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:45.535567 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3dfb3dd-8d82-4d51-b839-f13a1a1aae86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:45.536032 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b3dfb3dd-8d82-4d51-b839-f13a1a1aae86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:45.729637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b3dfb3dd-8d82-4d51-b839-f13a1a1aae86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:45.737450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2aa08037-b3a6-464a-a076-d77196947314 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:45.738244 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2aa08037-b3a6-464a-a076-d77196947314 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:45.744925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2aa08037-b3a6-464a-a076-d77196947314 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:45.745110 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b3dfb3dd-8d82-4d51-b839-f13a1a1aae86 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.222329 Jun 21 16:57:45.745411 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2aa08037-b3a6-464a-a076-d77196947314 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:45.746018 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 457/937] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:45 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:45.746238 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2aa08037-b3a6-464a-a076-d77196947314 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:45.757358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2aa08037-b3a6-464a-a076-d77196947314 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:45.881501 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2aa08037-b3a6-464a-a076-d77196947314 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:45.885693 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:45.891318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2aa08037-b3a6-464a-a076-d77196947314 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1367 microversion: 2.1 time: 0.157808 Jun 21 16:57:45.891891 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 481/938] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:45 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:46.497792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-70e06d11-5282-4533-b7ea-38df0997e660 req-479dab0c-768f-4324-8a5a-4463917f8a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227de214-598c-4afa-ad15-9ddb51d56ca9", "tag": "036c8d2f-ef99-48d2-b631-53e8019c1724"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:46.506627 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-70e06d11-5282-4533-b7ea-38df0997e660 req-479dab0c-768f-4324-8a5a-4463917f8a13 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:46.507311 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-70e06d11-5282-4533-b7ea-38df0997e660 req-479dab0c-768f-4324-8a5a-4463917f8a13 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:46.521964 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-70e06d11-5282-4533-b7ea-38df0997e660 req-479dab0c-768f-4324-8a5a-4463917f8a13 service nova] Creating event network-changed:036c8d2f-ef99-48d2-b631-53e8019c1724 for instance 227de214-598c-4afa-ad15-9ddb51d56ca9 on hv-cinder-79987 Jun 21 16:57:46.526680 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-70e06d11-5282-4533-b7ea-38df0997e660 req-479dab0c-768f-4324-8a5a-4463917f8a13 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036124 Jun 21 16:57:46.527712 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 458/939] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:57:46.770992 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-907546d0-d62c-4449-8d43-9ddabc43c9cd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:46.772325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-907546d0-d62c-4449-8d43-9ddabc43c9cd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:46.779296 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-907546d0-d62c-4449-8d43-9ddabc43c9cd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:46.779715 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-907546d0-d62c-4449-8d43-9ddabc43c9cd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:46.780724 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-907546d0-d62c-4449-8d43-9ddabc43c9cd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:46.781153 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-907546d0-d62c-4449-8d43-9ddabc43c9cd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:46.909369 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-18575c03-80c0-4e2b-87fb-0e2fbb0b9c35 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:46.910064 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-18575c03-80c0-4e2b-87fb-0e2fbb0b9c35 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:46.916822 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:46.921495 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-907546d0-d62c-4449-8d43-9ddabc43c9cd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:46.924986 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-18575c03-80c0-4e2b-87fb-0e2fbb0b9c35 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:46.925475 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-18575c03-80c0-4e2b-87fb-0e2fbb0b9c35 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:46.926238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-18575c03-80c0-4e2b-87fb-0e2fbb0b9c35 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:46.926666 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-18575c03-80c0-4e2b-87fb-0e2fbb0b9c35 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:46.937866 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-907546d0-d62c-4449-8d43-9ddabc43c9cd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.170611 Jun 21 16:57:46.938454 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 482/940] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:46 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:47.135016 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-18575c03-80c0-4e2b-87fb-0e2fbb0b9c35 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:47.143273 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-18575c03-80c0-4e2b-87fb-0e2fbb0b9c35 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1367 microversion: 2.1 time: 0.237987 Jun 21 16:57:47.143766 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 459/941] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:46 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:57:47.954953 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d8946ddf-ffab-42d6-ad7f-0f3e4ebfff8b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:47.955537 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d8946ddf-ffab-42d6-ad7f-0f3e4ebfff8b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:47.962353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d8946ddf-ffab-42d6-ad7f-0f3e4ebfff8b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:47.962799 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d8946ddf-ffab-42d6-ad7f-0f3e4ebfff8b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:47.963556 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d8946ddf-ffab-42d6-ad7f-0f3e4ebfff8b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:47.963988 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d8946ddf-ffab-42d6-ad7f-0f3e4ebfff8b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:48.100352 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d8946ddf-ffab-42d6-ad7f-0f3e4ebfff8b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:48.108800 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d8946ddf-ffab-42d6-ad7f-0f3e4ebfff8b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.158163 Jun 21 16:57:48.109376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 483/942] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:47 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:48.160112 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bcb86254-ebd4-49db-8661-f22096ef148a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:48.160748 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bcb86254-ebd4-49db-8661-f22096ef148a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:48.167534 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bcb86254-ebd4-49db-8661-f22096ef148a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:48.168185 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bcb86254-ebd4-49db-8661-f22096ef148a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:48.168948 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bcb86254-ebd4-49db-8661-f22096ef148a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:48.169409 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bcb86254-ebd4-49db-8661-f22096ef148a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:48.304480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-bcb86254-ebd4-49db-8661-f22096ef148a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:48.311993 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bcb86254-ebd4-49db-8661-f22096ef148a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1367 microversion: 2.1 time: 0.155897 Jun 21 16:57:48.312554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 460/943] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:48 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:49.126558 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c95f43f6-84f3-4573-ae9f-2ecb4a8fd246 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:49.127164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c95f43f6-84f3-4573-ae9f-2ecb4a8fd246 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:49.133967 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c95f43f6-84f3-4573-ae9f-2ecb4a8fd246 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:49.134416 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c95f43f6-84f3-4573-ae9f-2ecb4a8fd246 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:49.135238 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c95f43f6-84f3-4573-ae9f-2ecb4a8fd246 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:49.135615 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c95f43f6-84f3-4573-ae9f-2ecb4a8fd246 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:49.280512 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c95f43f6-84f3-4573-ae9f-2ecb4a8fd246 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:49.288258 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c95f43f6-84f3-4573-ae9f-2ecb4a8fd246 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.165677 Jun 21 16:57:49.288889 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 484/944] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:49 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:49.329176 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ca64f8e8-7a9b-4d99-9c5e-78f2ce335d46 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:49.329923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ca64f8e8-7a9b-4d99-9c5e-78f2ce335d46 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:49.331804 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=10 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:49.337405 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ca64f8e8-7a9b-4d99-9c5e-78f2ce335d46 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:49.338478 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ca64f8e8-7a9b-4d99-9c5e-78f2ce335d46 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:49.339266 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ca64f8e8-7a9b-4d99-9c5e-78f2ce335d46 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:49.339732 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ca64f8e8-7a9b-4d99-9c5e-78f2ce335d46 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:49.474500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ca64f8e8-7a9b-4d99-9c5e-78f2ce335d46 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:49.483199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ca64f8e8-7a9b-4d99-9c5e-78f2ce335d46 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1367 microversion: 2.1 time: 0.158024 Jun 21 16:57:49.483804 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 461/945] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:49 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:50.305969 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9547bd68-10e5-453d-b2dd-25a6de8d808e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:50.306494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9547bd68-10e5-453d-b2dd-25a6de8d808e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:50.313031 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9547bd68-10e5-453d-b2dd-25a6de8d808e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:50.313513 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9547bd68-10e5-453d-b2dd-25a6de8d808e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:50.314273 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9547bd68-10e5-453d-b2dd-25a6de8d808e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:50.314706 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9547bd68-10e5-453d-b2dd-25a6de8d808e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:50.452263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9547bd68-10e5-453d-b2dd-25a6de8d808e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:50.459853 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9547bd68-10e5-453d-b2dd-25a6de8d808e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.157866 Jun 21 16:57:50.460419 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 485/946] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:50 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:50.500011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6eeb7ca8-6033-4658-b137-7353796604b0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:50.500765 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6eeb7ca8-6033-4658-b137-7353796604b0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:50.507644 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6eeb7ca8-6033-4658-b137-7353796604b0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:50.508076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6eeb7ca8-6033-4658-b137-7353796604b0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:50.508837 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6eeb7ca8-6033-4658-b137-7353796604b0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:50.509265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6eeb7ca8-6033-4658-b137-7353796604b0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:50.646115 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6eeb7ca8-6033-4658-b137-7353796604b0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:50.654004 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6eeb7ca8-6033-4658-b137-7353796604b0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1367 microversion: 2.1 time: 0.157952 Jun 21 16:57:50.654555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 462/947] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:50 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:51.477535 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-af0ed655-684c-445e-ad3c-e3e764536d14 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:51.478148 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-af0ed655-684c-445e-ad3c-e3e764536d14 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:51.485430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-af0ed655-684c-445e-ad3c-e3e764536d14 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:51.485953 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-af0ed655-684c-445e-ad3c-e3e764536d14 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:51.486581 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-af0ed655-684c-445e-ad3c-e3e764536d14 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:51.487020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-af0ed655-684c-445e-ad3c-e3e764536d14 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:51.521193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-3614d5d0-3756-4eca-b99b-fa69d27f05f7 req-7f57dc8e-f647-4ef0-bf7e-1e8855682c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227de214-598c-4afa-ad15-9ddb51d56ca9", "name": "network-vif-plugged", "status": "completed", "tag": "036c8d2f-ef99-48d2-b631-53e8019c1724"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:51.534642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-3614d5d0-3756-4eca-b99b-fa69d27f05f7 req-7f57dc8e-f647-4ef0-bf7e-1e8855682c71 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:51.534642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-3614d5d0-3756-4eca-b99b-fa69d27f05f7 req-7f57dc8e-f647-4ef0-bf7e-1e8855682c71 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:51.548155 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-3614d5d0-3756-4eca-b99b-fa69d27f05f7 req-7f57dc8e-f647-4ef0-bf7e-1e8855682c71 service nova] Creating event network-vif-plugged:036c8d2f-ef99-48d2-b631-53e8019c1724 for instance 227de214-598c-4afa-ad15-9ddb51d56ca9 on hv-cinder-79987 Jun 21 16:57:51.553175 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-3614d5d0-3756-4eca-b99b-fa69d27f05f7 req-7f57dc8e-f647-4ef0-bf7e-1e8855682c71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035699 Jun 21 16:57:51.554592 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 463/948] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:57:51.630449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-af0ed655-684c-445e-ad3c-e3e764536d14 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:51.644397 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-af0ed655-684c-445e-ad3c-e3e764536d14 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.165926 Jun 21 16:57:51.644397 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 486/949] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:51 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:51.671576 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-04408adc-f7e6-4f21-b0e2-ee043221c4df tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:51.672527 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-04408adc-f7e6-4f21-b0e2-ee043221c4df tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:51.678850 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-04408adc-f7e6-4f21-b0e2-ee043221c4df tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:51.679283 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-04408adc-f7e6-4f21-b0e2-ee043221c4df tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:51.680052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-04408adc-f7e6-4f21-b0e2-ee043221c4df tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:51.680682 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-04408adc-f7e6-4f21-b0e2-ee043221c4df tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:51.818273 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-04408adc-f7e6-4f21-b0e2-ee043221c4df tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:51.821912 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:51.829393 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-04408adc-f7e6-4f21-b0e2-ee043221c4df tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1367 microversion: 2.1 time: 0.159867 Jun 21 16:57:51.829393 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 464/950] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:51 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:52.657503 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4024698e-d6e2-4d72-b05f-8146ae2eb8ab tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:52.658111 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4024698e-d6e2-4d72-b05f-8146ae2eb8ab tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:52.659935 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:52.661051 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=10 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:57:52.666201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4024698e-d6e2-4d72-b05f-8146ae2eb8ab tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:52.666640 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4024698e-d6e2-4d72-b05f-8146ae2eb8ab tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:52.667397 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4024698e-d6e2-4d72-b05f-8146ae2eb8ab tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:52.667863 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4024698e-d6e2-4d72-b05f-8146ae2eb8ab tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:52.802903 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4024698e-d6e2-4d72-b05f-8146ae2eb8ab tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:52.810429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4024698e-d6e2-4d72-b05f-8146ae2eb8ab tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.157944 Jun 21 16:57:52.815858 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 487/951] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:52 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:52.845303 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6dba5080-fd78-4b86-aadb-8355c7411fb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:52.845847 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6dba5080-fd78-4b86-aadb-8355c7411fb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:52.852675 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6dba5080-fd78-4b86-aadb-8355c7411fb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:52.853126 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6dba5080-fd78-4b86-aadb-8355c7411fb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:52.853923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6dba5080-fd78-4b86-aadb-8355c7411fb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:52.854358 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6dba5080-fd78-4b86-aadb-8355c7411fb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:52.988033 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6dba5080-fd78-4b86-aadb-8355c7411fb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:52.995762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6dba5080-fd78-4b86-aadb-8355c7411fb7 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1367 microversion: 2.1 time: 0.155381 Jun 21 16:57:52.996326 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 465/952] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:52 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:53.827599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f356ac92-5508-4476-b219-9d798037af12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:53.828214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f356ac92-5508-4476-b219-9d798037af12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:53.834997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f356ac92-5508-4476-b219-9d798037af12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:53.835452 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f356ac92-5508-4476-b219-9d798037af12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:53.842594 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f356ac92-5508-4476-b219-9d798037af12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:53.842594 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f356ac92-5508-4476-b219-9d798037af12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:53.976074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f356ac92-5508-4476-b219-9d798037af12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:53.984158 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f356ac92-5508-4476-b219-9d798037af12 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.160569 Jun 21 16:57:53.984729 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 488/953] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:53 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:54.015314 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3c02194c-a0aa-4bbd-a856-fca0c50040db tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:54.015930 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3c02194c-a0aa-4bbd-a856-fca0c50040db tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:54.022463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3c02194c-a0aa-4bbd-a856-fca0c50040db tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:54.022915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3c02194c-a0aa-4bbd-a856-fca0c50040db tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:54.023728 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3c02194c-a0aa-4bbd-a856-fca0c50040db tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:54.024135 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3c02194c-a0aa-4bbd-a856-fca0c50040db tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:54.157908 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-3c02194c-a0aa-4bbd-a856-fca0c50040db tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:54.165351 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3c02194c-a0aa-4bbd-a856-fca0c50040db tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1367 microversion: 2.1 time: 0.153939 Jun 21 16:57:54.165913 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 466/954] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:54 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:55.002542 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1b0dde71-5fd2-48c3-bb76-4fbdfe37d0bd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:55.003099 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1b0dde71-5fd2-48c3-bb76-4fbdfe37d0bd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:55.010051 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1b0dde71-5fd2-48c3-bb76-4fbdfe37d0bd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:55.010504 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1b0dde71-5fd2-48c3-bb76-4fbdfe37d0bd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:55.011274 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1b0dde71-5fd2-48c3-bb76-4fbdfe37d0bd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:55.011712 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1b0dde71-5fd2-48c3-bb76-4fbdfe37d0bd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:55.156488 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-1b0dde71-5fd2-48c3-bb76-4fbdfe37d0bd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:55.164347 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1b0dde71-5fd2-48c3-bb76-4fbdfe37d0bd tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.165861 Jun 21 16:57:55.164908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 489/955] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:54 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:55.182551 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ab8441ad-505a-4806-95a4-3d3a99d37857 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:55.192504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ab8441ad-505a-4806-95a4-3d3a99d37857 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:55.192504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ab8441ad-505a-4806-95a4-3d3a99d37857 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:55.192504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ab8441ad-505a-4806-95a4-3d3a99d37857 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:55.192504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ab8441ad-505a-4806-95a4-3d3a99d37857 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:55.192950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ab8441ad-505a-4806-95a4-3d3a99d37857 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:55.327503 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ab8441ad-505a-4806-95a4-3d3a99d37857 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:55.335052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ab8441ad-505a-4806-95a4-3d3a99d37857 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1367 microversion: 2.1 time: 0.156488 Jun 21 16:57:55.335624 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 467/956] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:55 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:56.181463 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-2ff3d386-4aa1-4e47-8275-178cce53276f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:56.182027 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-2ff3d386-4aa1-4e47-8275-178cce53276f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:56.189097 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2ff3d386-4aa1-4e47-8275-178cce53276f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:56.189572 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2ff3d386-4aa1-4e47-8275-178cce53276f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:56.190324 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2ff3d386-4aa1-4e47-8275-178cce53276f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:56.190754 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-2ff3d386-4aa1-4e47-8275-178cce53276f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:56.329265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-2ff3d386-4aa1-4e47-8275-178cce53276f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:56.336922 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-2ff3d386-4aa1-4e47-8275-178cce53276f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.159541 Jun 21 16:57:56.337521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 490/957] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:56 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:56.353191 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e15eb371-1a39-4195-aacb-635e17676fe8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:56.357422 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e15eb371-1a39-4195-aacb-635e17676fe8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:56.360819 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e15eb371-1a39-4195-aacb-635e17676fe8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:56.361264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e15eb371-1a39-4195-aacb-635e17676fe8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:56.362048 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e15eb371-1a39-4195-aacb-635e17676fe8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:56.362480 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e15eb371-1a39-4195-aacb-635e17676fe8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:56.494729 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e15eb371-1a39-4195-aacb-635e17676fe8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:56.502914 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e15eb371-1a39-4195-aacb-635e17676fe8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1557 microversion: 2.1 time: 0.153686 Jun 21 16:57:56.505565 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 468/958] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:56 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:56.520267 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8acb71c0-27fd-4e8c-aa44-90f292535d72 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:56.520759 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8acb71c0-27fd-4e8c-aa44-90f292535d72 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:56.526836 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8acb71c0-27fd-4e8c-aa44-90f292535d72 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:56.527283 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8acb71c0-27fd-4e8c-aa44-90f292535d72 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:56.528036 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8acb71c0-27fd-4e8c-aa44-90f292535d72 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:56.529456 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8acb71c0-27fd-4e8c-aa44-90f292535d72 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:56.607114 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8acb71c0-27fd-4e8c-aa44-90f292535d72 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090757 Jun 21 16:57:56.607700 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 491/959] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 16:57:56 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:57.354680 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e9b40669-dca4-4137-887e-a09e2a0e0457 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:57.355235 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e9b40669-dca4-4137-887e-a09e2a0e0457 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:57.361742 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e9b40669-dca4-4137-887e-a09e2a0e0457 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:57.362191 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e9b40669-dca4-4137-887e-a09e2a0e0457 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:57.363044 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e9b40669-dca4-4137-887e-a09e2a0e0457 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:57.363478 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e9b40669-dca4-4137-887e-a09e2a0e0457 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:57.509980 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e9b40669-dca4-4137-887e-a09e2a0e0457 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:57.522449 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e9b40669-dca4-4137-887e-a09e2a0e0457 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.171651 Jun 21 16:57:57.523203 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 469/960] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:57 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:57.556378 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-6ee3b584-1948-49ec-938c-51356832e5e3 req-80e135d2-b70f-4026-be29-57935221218f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc11023-ceb3-4f72-83d3-a4ea95eb2863", "name": "network-vif-plugged", "status": "completed", "tag": "711a0b2d-04b6-4f67-8f42-73102320e7af"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:57.566982 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6ee3b584-1948-49ec-938c-51356832e5e3 req-80e135d2-b70f-4026-be29-57935221218f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:57.568882 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-6ee3b584-1948-49ec-938c-51356832e5e3 req-80e135d2-b70f-4026-be29-57935221218f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:57.579918 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-6ee3b584-1948-49ec-938c-51356832e5e3 req-80e135d2-b70f-4026-be29-57935221218f service nova] Creating event network-vif-plugged:711a0b2d-04b6-4f67-8f42-73102320e7af for instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 on hv-cinder-79987 Jun 21 16:57:57.585254 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-6ee3b584-1948-49ec-938c-51356832e5e3 req-80e135d2-b70f-4026-be29-57935221218f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033197 Jun 21 16:57:57.586179 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 492/961] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:57:57.640206 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-94c57217-97ab-4720-9511-6e7cde41d303 req-0f9deb6e-92b0-4d02-b4bb-d35796bd8bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227de214-598c-4afa-ad15-9ddb51d56ca9", "tag": "036c8d2f-ef99-48d2-b631-53e8019c1724"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:57:57.648550 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-94c57217-97ab-4720-9511-6e7cde41d303 req-0f9deb6e-92b0-4d02-b4bb-d35796bd8bda service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:57.649160 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-94c57217-97ab-4720-9511-6e7cde41d303 req-0f9deb6e-92b0-4d02-b4bb-d35796bd8bda service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:57.660693 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-94c57217-97ab-4720-9511-6e7cde41d303 req-0f9deb6e-92b0-4d02-b4bb-d35796bd8bda service nova] Creating event network-changed:036c8d2f-ef99-48d2-b631-53e8019c1724 for instance 227de214-598c-4afa-ad15-9ddb51d56ca9 on hv-cinder-79987 Jun 21 16:57:57.665554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-94c57217-97ab-4720-9511-6e7cde41d303 req-0f9deb6e-92b0-4d02-b4bb-d35796bd8bda service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030079 Jun 21 16:57:57.666193 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 470/962] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:57:58.540531 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c00ac967-0f4c-4c5c-bf38-bc02bfa24da1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:58.541382 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c00ac967-0f4c-4c5c-bf38-bc02bfa24da1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:58.548489 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c00ac967-0f4c-4c5c-bf38-bc02bfa24da1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:58.548940 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c00ac967-0f4c-4c5c-bf38-bc02bfa24da1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:58.549783 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c00ac967-0f4c-4c5c-bf38-bc02bfa24da1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:58.550220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c00ac967-0f4c-4c5c-bf38-bc02bfa24da1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:58.692661 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-c00ac967-0f4c-4c5c-bf38-bc02bfa24da1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:58.700867 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c00ac967-0f4c-4c5c-bf38-bc02bfa24da1 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.164770 Jun 21 16:57:58.701637 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 493/963] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:58 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:57:59.719971 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e7a24d2a-4eed-49c0-a7b1-519a11bafe13 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:57:59.720671 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-e7a24d2a-4eed-49c0-a7b1-519a11bafe13 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:57:59.726953 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e7a24d2a-4eed-49c0-a7b1-519a11bafe13 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:59.727400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e7a24d2a-4eed-49c0-a7b1-519a11bafe13 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:59.728174 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e7a24d2a-4eed-49c0-a7b1-519a11bafe13 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:57:59.728622 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-e7a24d2a-4eed-49c0-a7b1-519a11bafe13 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:57:59.867919 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-e7a24d2a-4eed-49c0-a7b1-519a11bafe13 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:57:59.875923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e7a24d2a-4eed-49c0-a7b1-519a11bafe13 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.161568 Jun 21 16:57:59.876488 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 471/964] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:57:59 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:00.892582 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-169c919a-e0d4-451d-9565-a70a1470fe35 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:00.893207 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-169c919a-e0d4-451d-9565-a70a1470fe35 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:00.899952 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-169c919a-e0d4-451d-9565-a70a1470fe35 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:00.900400 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-169c919a-e0d4-451d-9565-a70a1470fe35 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:00.901208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-169c919a-e0d4-451d-9565-a70a1470fe35 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:00.901687 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-169c919a-e0d4-451d-9565-a70a1470fe35 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:01.039179 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-169c919a-e0d4-451d-9565-a70a1470fe35 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:01.047019 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-169c919a-e0d4-451d-9565-a70a1470fe35 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.158367 Jun 21 16:58:01.047691 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 494/965] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:00 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:02.064205 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8d28bdb4-b254-4ff2-a237-a7010ab57640 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:02.064806 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8d28bdb4-b254-4ff2-a237-a7010ab57640 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:02.071677 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8d28bdb4-b254-4ff2-a237-a7010ab57640 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:02.072184 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8d28bdb4-b254-4ff2-a237-a7010ab57640 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:02.072959 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8d28bdb4-b254-4ff2-a237-a7010ab57640 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:02.073427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8d28bdb4-b254-4ff2-a237-a7010ab57640 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:02.230651 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8d28bdb4-b254-4ff2-a237-a7010ab57640 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:02.238905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8d28bdb4-b254-4ff2-a237-a7010ab57640 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.178840 Jun 21 16:58:02.239466 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 472/966] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:02 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:03.255827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5b1ddb3f-c84d-48a8-aa9e-043e013def1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:03.256675 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5b1ddb3f-c84d-48a8-aa9e-043e013def1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:03.264002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5b1ddb3f-c84d-48a8-aa9e-043e013def1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:03.264450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5b1ddb3f-c84d-48a8-aa9e-043e013def1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:03.265214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5b1ddb3f-c84d-48a8-aa9e-043e013def1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:03.265669 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5b1ddb3f-c84d-48a8-aa9e-043e013def1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:03.398301 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-5b1ddb3f-c84d-48a8-aa9e-043e013def1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:03.406104 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5b1ddb3f-c84d-48a8-aa9e-043e013def1e tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1266 microversion: 2.1 time: 0.154073 Jun 21 16:58:03.406700 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 495/967] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:03 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:04.424158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0eb654a5-d999-4417-ad9a-f60c2bcc4cb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:04.424712 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0eb654a5-d999-4417-ad9a-f60c2bcc4cb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:04.427094 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:04.431757 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0eb654a5-d999-4417-ad9a-f60c2bcc4cb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:04.432197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0eb654a5-d999-4417-ad9a-f60c2bcc4cb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:04.432952 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0eb654a5-d999-4417-ad9a-f60c2bcc4cb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:04.433408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0eb654a5-d999-4417-ad9a-f60c2bcc4cb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:04.567327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0eb654a5-d999-4417-ad9a-f60c2bcc4cb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:04.574806 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0eb654a5-d999-4417-ad9a-f60c2bcc4cb8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1453 microversion: 2.1 time: 0.155679 Jun 21 16:58:04.575963 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 473/968] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:04 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:04.591878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4b08f7ed-5aee-44f7-8db8-3f8fe2601fb4 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:04.592623 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4b08f7ed-5aee-44f7-8db8-3f8fe2601fb4 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:04.599632 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4b08f7ed-5aee-44f7-8db8-3f8fe2601fb4 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:04.600084 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4b08f7ed-5aee-44f7-8db8-3f8fe2601fb4 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:04.600860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4b08f7ed-5aee-44f7-8db8-3f8fe2601fb4 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:04.601315 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4b08f7ed-5aee-44f7-8db8-3f8fe2601fb4 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:04.744374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4b08f7ed-5aee-44f7-8db8-3f8fe2601fb4 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:04.755594 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4b08f7ed-5aee-44f7-8db8-3f8fe2601fb4 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1453 microversion: 2.1 time: 0.168034 Jun 21 16:58:04.756157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 496/969] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:04 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:07.211400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-eac711ea-4586-4895-afbf-653a0b0ec248 req-39ca102c-b2f3-494e-a1a9-5e43bfb95ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc11023-ceb3-4f72-83d3-a4ea95eb2863", "tag": "711a0b2d-04b6-4f67-8f42-73102320e7af"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:58:07.222286 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-eac711ea-4586-4895-afbf-653a0b0ec248 req-39ca102c-b2f3-494e-a1a9-5e43bfb95ae0 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:07.222947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-eac711ea-4586-4895-afbf-653a0b0ec248 req-39ca102c-b2f3-494e-a1a9-5e43bfb95ae0 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:07.243084 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-eac711ea-4586-4895-afbf-653a0b0ec248 req-39ca102c-b2f3-494e-a1a9-5e43bfb95ae0 service nova] Creating event network-changed:711a0b2d-04b6-4f67-8f42-73102320e7af for instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 on hv-cinder-79987 Jun 21 16:58:07.248052 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-eac711ea-4586-4895-afbf-653a0b0ec248 req-39ca102c-b2f3-494e-a1a9-5e43bfb95ae0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040290 Jun 21 16:58:07.250927 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 474/970] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:58:08.157048 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a8175f7c-f91e-4211-b7fc-0041a0f34f3d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:08.157632 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a8175f7c-f91e-4211-b7fc-0041a0f34f3d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:08.160091 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:08.164881 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a8175f7c-f91e-4211-b7fc-0041a0f34f3d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:08.165363 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a8175f7c-f91e-4211-b7fc-0041a0f34f3d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:08.166139 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a8175f7c-f91e-4211-b7fc-0041a0f34f3d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:08.166580 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a8175f7c-f91e-4211-b7fc-0041a0f34f3d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:08.251997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-a8175f7c-f91e-4211-b7fc-0041a0f34f3d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lazy-loading 'services' on Instance uuid 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:58:08.486279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a8175f7c-f91e-4211-b7fc-0041a0f34f3d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2/os-volume_attachments/a4cb82f6-ff21-4729-942c-a10468e3ab4c" status: 202 len: 0 microversion: 2.1 time: 0.332957 Jun 21 16:58:08.486879 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 497/971] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 16:58:08 2022] DELETE /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2/os-volume_attachments/a4cb82f6-ff21-4729-942c-a10468e3ab4c => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:58:09.620849 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2fe63c04-a760-493c-8a47-26baff4361be tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:09.621589 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2fe63c04-a760-493c-8a47-26baff4361be tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:09.628649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2fe63c04-a760-493c-8a47-26baff4361be tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:09.632725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2fe63c04-a760-493c-8a47-26baff4361be tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:09.632725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2fe63c04-a760-493c-8a47-26baff4361be tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:09.632725 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2fe63c04-a760-493c-8a47-26baff4361be tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:09.656353 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2fe63c04-a760-493c-8a47-26baff4361be tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:58:09.931659 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2fe63c04-a760-493c-8a47-26baff4361be tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 204 len: 0 microversion: 2.1 time: 0.315305 Jun 21 16:58:09.932248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 475/972] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:58:09 2022] DELETE /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:58:09.942446 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-ba6683d3-3b77-4504-a909-582f590e96b1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:09.943159 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-ba6683d3-3b77-4504-a909-582f590e96b1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:09.950049 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ba6683d3-3b77-4504-a909-582f590e96b1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:09.951154 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ba6683d3-3b77-4504-a909-582f590e96b1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:09.951281 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ba6683d3-3b77-4504-a909-582f590e96b1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:09.951756 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-ba6683d3-3b77-4504-a909-582f590e96b1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:10.083849 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-ba6683d3-3b77-4504-a909-582f590e96b1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:10.087587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:10.092199 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-ba6683d3-3b77-4504-a909-582f590e96b1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1514 microversion: 2.1 time: 0.154681 Jun 21 16:58:10.092821 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 498/973] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:09 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:11.111335 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6184dbdf-b3e0-41a4-bc34-c13351ea36c1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:11.112029 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6184dbdf-b3e0-41a4-bc34-c13351ea36c1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:11.118500 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6184dbdf-b3e0-41a4-bc34-c13351ea36c1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:11.118943 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6184dbdf-b3e0-41a4-bc34-c13351ea36c1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:11.119701 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6184dbdf-b3e0-41a4-bc34-c13351ea36c1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:11.120129 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6184dbdf-b3e0-41a4-bc34-c13351ea36c1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:11.258257 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6184dbdf-b3e0-41a4-bc34-c13351ea36c1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:11.267013 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6184dbdf-b3e0-41a4-bc34-c13351ea36c1 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1514 microversion: 2.1 time: 0.159998 Jun 21 16:58:11.267799 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 476/974] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:11 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:12.285483 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e8488442-b668-41eb-b580-a76c43dcec32 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:12.286112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e8488442-b668-41eb-b580-a76c43dcec32 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:12.294575 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8488442-b668-41eb-b580-a76c43dcec32 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:12.295262 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8488442-b668-41eb-b580-a76c43dcec32 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:12.296074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8488442-b668-41eb-b580-a76c43dcec32 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:12.296504 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e8488442-b668-41eb-b580-a76c43dcec32 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:12.307623 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-bab3e4be-c82e-4f7d-9d6d-502b0b6e54b2 req-a2c1bf36-71d4-4481-91e3-6de723232c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9ed311-c5b6-495a-b6d7-ac929d95d8b2", "name": "network-vif-deleted", "tag": "28c431e8-c7c1-48ff-b319-2da54d99e5d4"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:58:12.316836 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-bab3e4be-c82e-4f7d-9d6d-502b0b6e54b2 req-a2c1bf36-71d4-4481-91e3-6de723232c6f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:12.317452 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-bab3e4be-c82e-4f7d-9d6d-502b0b6e54b2 req-a2c1bf36-71d4-4481-91e3-6de723232c6f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:12.333211 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-bab3e4be-c82e-4f7d-9d6d-502b0b6e54b2 req-a2c1bf36-71d4-4481-91e3-6de723232c6f service nova] Creating event network-vif-deleted:28c431e8-c7c1-48ff-b319-2da54d99e5d4 for instance 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 on hv-cinder-79987 Jun 21 16:58:12.335455 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-bab3e4be-c82e-4f7d-9d6d-502b0b6e54b2 req-a2c1bf36-71d4-4481-91e3-6de723232c6f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031733 Jun 21 16:58:12.336608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 477/975] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:58:12.364113 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e8488442-b668-41eb-b580-a76c43dcec32 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:12.372155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e8488442-b668-41eb-b580-a76c43dcec32 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 200 len: 1472 microversion: 2.1 time: 0.090738 Jun 21 16:58:12.372710 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 499/976] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:12 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 1472 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:13.392188 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:13.393809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:13.402579 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:13.403023 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:13.403826 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:13.404255 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:13.418407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] HTTP exception thrown: Instance 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 could not be found. Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Request method failure captured: Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 HTTP/1.1 Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfhZxsWkpnq_wupfAU4UQa-L0v-AO0VuFcaYDcmUMGYpnMK6bqeCzjEKHHtZ0ofWzhBeoyqTlUEMJTs4-r2zkWMJ44ewIUDtzgkjodEyMKZxclE5rGuvB1FnekTEz8zV0Zub-cezGRYumm1d1tm-TwkmTawW-KFUFJ-EOwCMsFEiqkY Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 7dddfcc30ee8433c9f48d7153b416f21 Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1970342923 Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:58:13.420045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7dddfcc30ee8433c9f48d7153b416f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7dddfcc30ee8433c9f48d7153b416f21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7dddfcc30ee8433c9f48d7153b416f21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7dddfcc30ee8433c9f48d7153b416f21", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-VolumesSnapshotTestJSON-1970342923 Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 7dddfcc30ee8433c9f48d7153b416f21 Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1970342923 Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-VolumesSnapshotTestJSON-1970342923-project Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: dfc90b18a1f44d1eb1bba4e64fa1d3a1 Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-VolumesSnapshotTestJSON-1970342923-project Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 could not be found. Jun 21 16:58:13.422606 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '7b9ed311-c5b6-495a-b6d7-ac929d95d8b2'} Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 could not be found. Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:58:13.423636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 could not be found. Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 could not be found. Jun 21 16:58:13.425264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:13.426761 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Returning 404 to user: Instance 7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:58:13.426761 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6b85c484-2e12-4463-9742-e53233c4eacb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2" status: 404 len: 111 microversion: 2.1 time: 0.035471 Jun 21 16:58:13.426761 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 478/977] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:13 2022] GET /compute/v2.1/servers/7b9ed311-c5b6-495a-b6d7-ac929d95d8b2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:58:23.841743 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1163278190", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "networks": [{"uuid": "09788440-c818-4ffe-850a-f3f22fe9f60f"}]}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:58:23.849814 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=5 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:23.850451 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=6 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:23.895744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] validate_networks() for [('09788440-c818-4ffe-850a-f3f22fe9f60f', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:58:24.243427 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:58:24.243858 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:58:24.244467 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:58:24.244878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:58:24.245307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:58:24.255464 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:24.255830 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:24.256884 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:24.257518 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:24.275553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Getting quotas for project 7dddfcc30ee8433c9f48d7153b416f21. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:58:24.279454 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Getting quotas for user dfc90b18a1f44d1eb1bba4e64fa1d3a1 and project 7dddfcc30ee8433c9f48d7153b416f21. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:58:24.292292 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:58:24.294674 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:58:24.470412 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a601590d-bf5e-4820-9fe4-55bc4c4255a6 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632461 Jun 21 16:58:24.471022 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 500/978] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:58:24.490264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6bcb1764-9b76-401a-ad77-753082c5324b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:24.491817 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6bcb1764-9b76-401a-ad77-753082c5324b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:24.495029 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:24.495029 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:24.549572 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6bcb1764-9b76-401a-ad77-753082c5324b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:24.556278 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6bcb1764-9b76-401a-ad77-753082c5324b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1219 microversion: 2.1 time: 0.069937 Jun 21 16:58:24.556826 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 479/979] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:24 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:25.573307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3f712a39-c695-4d44-8431-f031b9a991e8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:25.573922 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3f712a39-c695-4d44-8431-f031b9a991e8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:25.581645 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f712a39-c695-4d44-8431-f031b9a991e8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:25.585002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f712a39-c695-4d44-8431-f031b9a991e8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:25.585002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f712a39-c695-4d44-8431-f031b9a991e8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:25.585002 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f712a39-c695-4d44-8431-f031b9a991e8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:25.646415 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3f712a39-c695-4d44-8431-f031b9a991e8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:25.653891 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3f712a39-c695-4d44-8431-f031b9a991e8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1223 microversion: 2.1 time: 0.084939 Jun 21 16:58:25.654457 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 501/980] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:25 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:26.672498 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7dc07314-15c6-480d-8611-7013f38be97b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:26.673214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-7dc07314-15c6-480d-8611-7013f38be97b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:26.682851 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7dc07314-15c6-480d-8611-7013f38be97b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:26.683336 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7dc07314-15c6-480d-8611-7013f38be97b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:26.684146 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7dc07314-15c6-480d-8611-7013f38be97b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:26.684574 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7dc07314-15c6-480d-8611-7013f38be97b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:26.771264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-7dc07314-15c6-480d-8611-7013f38be97b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:26.778758 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-7dc07314-15c6-480d-8611-7013f38be97b tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1289 microversion: 2.1 time: 0.110279 Jun 21 16:58:26.779320 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 480/981] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:26 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:27.798486 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fb9de691-a397-428f-9106-ab360441bde8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:27.799611 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fb9de691-a397-428f-9106-ab360441bde8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:27.805862 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fb9de691-a397-428f-9106-ab360441bde8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:27.806314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fb9de691-a397-428f-9106-ab360441bde8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:27.807078 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fb9de691-a397-428f-9106-ab360441bde8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:27.807512 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fb9de691-a397-428f-9106-ab360441bde8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:27.942742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fb9de691-a397-428f-9106-ab360441bde8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:27.950335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fb9de691-a397-428f-9106-ab360441bde8 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1319 microversion: 2.1 time: 0.155774 Jun 21 16:58:27.950909 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 502/982] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:27 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:58:28.290133 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-b606d2b9-713a-4d4f-accf-51e4bc2fc643 req-ee761e5d-aff8-4c17-92df-3632cc51645a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd479a87-25ae-4f57-b67f-ceaa4cab0944", "tag": "52d0a763-bfbe-46fb-994d-eeff14264891"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:58:28.300674 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-b606d2b9-713a-4d4f-accf-51e4bc2fc643 req-ee761e5d-aff8-4c17-92df-3632cc51645a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:28.301404 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-b606d2b9-713a-4d4f-accf-51e4bc2fc643 req-ee761e5d-aff8-4c17-92df-3632cc51645a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:28.313891 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-b606d2b9-713a-4d4f-accf-51e4bc2fc643 req-ee761e5d-aff8-4c17-92df-3632cc51645a service nova] Creating event network-changed:52d0a763-bfbe-46fb-994d-eeff14264891 for instance fd479a87-25ae-4f57-b67f-ceaa4cab0944 on hv-cinder-79987 Jun 21 16:58:28.319116 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-b606d2b9-713a-4d4f-accf-51e4bc2fc643 req-ee761e5d-aff8-4c17-92df-3632cc51645a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032852 Jun 21 16:58:28.319886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 481/983] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:58:28.968020 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a1cf1016-8234-4afd-b25b-ceb7dde1d3d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:28.968555 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a1cf1016-8234-4afd-b25b-ceb7dde1d3d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:28.975191 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a1cf1016-8234-4afd-b25b-ceb7dde1d3d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:28.975644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a1cf1016-8234-4afd-b25b-ceb7dde1d3d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:28.976408 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a1cf1016-8234-4afd-b25b-ceb7dde1d3d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:28.976846 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a1cf1016-8234-4afd-b25b-ceb7dde1d3d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:29.107054 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a1cf1016-8234-4afd-b25b-ceb7dde1d3d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:29.114674 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a1cf1016-8234-4afd-b25b-ceb7dde1d3d9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1319 microversion: 2.1 time: 0.150618 Jun 21 16:58:29.115251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 503/984] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:28 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:30.132246 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-17c1b564-4df2-451c-b4ee-be3cabd8cbf7 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:30.132953 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-17c1b564-4df2-451c-b4ee-be3cabd8cbf7 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:30.140491 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17c1b564-4df2-451c-b4ee-be3cabd8cbf7 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:30.140855 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17c1b564-4df2-451c-b4ee-be3cabd8cbf7 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:30.141548 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17c1b564-4df2-451c-b4ee-be3cabd8cbf7 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:30.141994 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-17c1b564-4df2-451c-b4ee-be3cabd8cbf7 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:30.285394 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-17c1b564-4df2-451c-b4ee-be3cabd8cbf7 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:30.293002 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-17c1b564-4df2-451c-b4ee-be3cabd8cbf7 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1319 microversion: 2.1 time: 0.165215 Jun 21 16:58:30.293616 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 482/985] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:30 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:31.309572 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-805e546d-734a-48e5-bb8f-d716b1c4f829 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:31.310177 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-805e546d-734a-48e5-bb8f-d716b1c4f829 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:31.316869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-805e546d-734a-48e5-bb8f-d716b1c4f829 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:31.317351 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-805e546d-734a-48e5-bb8f-d716b1c4f829 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:31.318118 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-805e546d-734a-48e5-bb8f-d716b1c4f829 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:31.318810 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-805e546d-734a-48e5-bb8f-d716b1c4f829 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:31.457524 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-805e546d-734a-48e5-bb8f-d716b1c4f829 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:31.465093 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-805e546d-734a-48e5-bb8f-d716b1c4f829 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1319 microversion: 2.1 time: 0.159492 Jun 21 16:58:31.465884 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 504/986] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:31 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:32.482843 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a0cb849e-3c6e-4b55-bda1-0e8911b67fe9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:32.483433 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a0cb849e-3c6e-4b55-bda1-0e8911b67fe9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:32.491180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a0cb849e-3c6e-4b55-bda1-0e8911b67fe9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:32.491621 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a0cb849e-3c6e-4b55-bda1-0e8911b67fe9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:32.492390 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a0cb849e-3c6e-4b55-bda1-0e8911b67fe9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:32.492819 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a0cb849e-3c6e-4b55-bda1-0e8911b67fe9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:32.627529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a0cb849e-3c6e-4b55-bda1-0e8911b67fe9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:32.635138 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a0cb849e-3c6e-4b55-bda1-0e8911b67fe9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1319 microversion: 2.1 time: 0.156136 Jun 21 16:58:32.635689 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 483/987] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:32 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:33.508397 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-8f673e5e-79e8-4e1c-97eb-2b4b518547e6 req-43f0eb7b-aea3-4787-b088-9b5846a17e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd479a87-25ae-4f57-b67f-ceaa4cab0944", "name": "network-vif-plugged", "status": "completed", "tag": "52d0a763-bfbe-46fb-994d-eeff14264891"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:58:33.517170 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-8f673e5e-79e8-4e1c-97eb-2b4b518547e6 req-43f0eb7b-aea3-4787-b088-9b5846a17e75 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:33.517823 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-8f673e5e-79e8-4e1c-97eb-2b4b518547e6 req-43f0eb7b-aea3-4787-b088-9b5846a17e75 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:33.528618 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-8f673e5e-79e8-4e1c-97eb-2b4b518547e6 req-43f0eb7b-aea3-4787-b088-9b5846a17e75 service nova] Creating event network-vif-plugged:52d0a763-bfbe-46fb-994d-eeff14264891 for instance fd479a87-25ae-4f57-b67f-ceaa4cab0944 on hv-cinder-79987 Jun 21 16:58:33.534235 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-8f673e5e-79e8-4e1c-97eb-2b4b518547e6 req-43f0eb7b-aea3-4787-b088-9b5846a17e75 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029220 Jun 21 16:58:33.534789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 505/988] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:58:33.651807 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-98820ff0-089e-4f75-ba8b-ac1560969c9f tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:33.652520 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-98820ff0-089e-4f75-ba8b-ac1560969c9f tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:33.659949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-98820ff0-089e-4f75-ba8b-ac1560969c9f tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:33.660494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-98820ff0-089e-4f75-ba8b-ac1560969c9f tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:33.661370 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-98820ff0-089e-4f75-ba8b-ac1560969c9f tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:33.661899 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-98820ff0-089e-4f75-ba8b-ac1560969c9f tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:33.847022 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-98820ff0-089e-4f75-ba8b-ac1560969c9f tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:33.854413 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-98820ff0-089e-4f75-ba8b-ac1560969c9f tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1319 microversion: 2.1 time: 0.206472 Jun 21 16:58:33.858361 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 484/989] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:33 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:34.868950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:34.869676 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=6 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:34.874153 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-be77635d-a7b9-4d02-a4c6-247c1af5a602 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:34.874844 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-be77635d-a7b9-4d02-a4c6-247c1af5a602 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:34.881840 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be77635d-a7b9-4d02-a4c6-247c1af5a602 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:34.882291 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be77635d-a7b9-4d02-a4c6-247c1af5a602 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:34.883047 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be77635d-a7b9-4d02-a4c6-247c1af5a602 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:34.883505 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-be77635d-a7b9-4d02-a4c6-247c1af5a602 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:35.015378 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-be77635d-a7b9-4d02-a4c6-247c1af5a602 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:35.023453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-be77635d-a7b9-4d02-a4c6-247c1af5a602 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1319 microversion: 2.1 time: 0.155508 Jun 21 16:58:35.024041 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 506/990] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:34 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:36.040439 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2d7e825a-74d0-4217-8426-0dc75cde31eb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:36.041047 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2d7e825a-74d0-4217-8426-0dc75cde31eb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:36.043058 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=2 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:36.048351 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2d7e825a-74d0-4217-8426-0dc75cde31eb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:36.049183 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2d7e825a-74d0-4217-8426-0dc75cde31eb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:36.059057 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2d7e825a-74d0-4217-8426-0dc75cde31eb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:36.059057 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2d7e825a-74d0-4217-8426-0dc75cde31eb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:36.182872 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2d7e825a-74d0-4217-8426-0dc75cde31eb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:36.190683 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2d7e825a-74d0-4217-8426-0dc75cde31eb tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1509 microversion: 2.1 time: 0.154211 Jun 21 16:58:36.191293 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 485/991] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:36 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:36.207698 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-aeee66f0-6535-4eaa-b2b4-69d84ed63773 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edcf3d17-15d3-4362-8f6a-c7ffe381ebd5", "device": "/dev/sdb"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:58:36.209259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-aeee66f0-6535-4eaa-b2b4-69d84ed63773 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:36.215702 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aeee66f0-6535-4eaa-b2b4-69d84ed63773 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:36.216154 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aeee66f0-6535-4eaa-b2b4-69d84ed63773 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:36.216925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aeee66f0-6535-4eaa-b2b4-69d84ed63773 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:36.217397 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-aeee66f0-6535-4eaa-b2b4-69d84ed63773 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:37.083610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-aeee66f0-6535-4eaa-b2b4-69d84ed63773 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "POST /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880349 Jun 21 16:58:37.084214 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 507/992] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:58:36 2022] POST /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944/os-volume_attachments => generated 194 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:58:42.247830 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-33a7b5c5-b564-4aec-907e-ad2744c62e2c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:42.248473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-33a7b5c5-b564-4aec-907e-ad2744c62e2c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:42.255411 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-33a7b5c5-b564-4aec-907e-ad2744c62e2c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:42.256392 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-33a7b5c5-b564-4aec-907e-ad2744c62e2c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:42.256943 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-33a7b5c5-b564-4aec-907e-ad2744c62e2c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:42.257591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-33a7b5c5-b564-4aec-907e-ad2744c62e2c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:42.280586 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-33a7b5c5-b564-4aec-907e-ad2744c62e2c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/ips" status: 200 len: 150 microversion: 2.1 time: 0.036788 Jun 21 16:58:42.281145 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 486/993] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 16:58:42 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:58:43.912787 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9d1a9704-4a52-41fa-b026-56e2e14f56aa tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88cd93c3-c039-4a73-a876-b1094b91386a"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:58:43.913967 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9d1a9704-4a52-41fa-b026-56e2e14f56aa tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:43.920230 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9d1a9704-4a52-41fa-b026-56e2e14f56aa tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:43.920680 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9d1a9704-4a52-41fa-b026-56e2e14f56aa tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:43.921488 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9d1a9704-4a52-41fa-b026-56e2e14f56aa tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:43.921963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9d1a9704-4a52-41fa-b026-56e2e14f56aa tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:45.003588 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9d1a9704-4a52-41fa-b026-56e2e14f56aa tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.096212 Jun 21 16:58:45.004194 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 508/994] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:58:43 2022] POST /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments => generated 194 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:58:55.668581 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88cd93c3-c039-4a73-a876-b1094b91386a"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:58:55.669702 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:55.672777 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=18 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:55.673507 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=36 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:55.679929 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:55.679929 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:55.680373 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:55.681171 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:55.817499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Invalid volume: volume 88cd93c3-c039-4a73-a876-b1094b91386a is already attached to instances: 227de214-598c-4afa-ad15-9ddb51d56ca9 Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: POST /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments HTTP/1.1 Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 74 Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 16:58:55.819357 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {"volumeAttachment": {"volumeId": "88cd93c3-c039-4a73-a876-b1094b91386a"}} Jun 21 16:58:55.821118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Invalid volume: volume 88cd93c3-c039-4a73-a876-b1094b91386a is already attached to instances: 227de214-598c-4afa-ad15-9ddb51d56ca9 Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'server_id': '227de214-598c-4afa-ad15-9ddb51d56ca9', 'body': {'volumeAttachment': {'volumeId': '88cd93c3-c039-4a73-a876-b1094b91386a'}}} Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 88cd93c3-c039-4a73-a876-b1094b91386a is already attached to instances: 227de214-598c-4afa-ad15-9ddb51d56ca9 Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:55.822327 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 88cd93c3-c039-4a73-a876-b1094b91386a is already attached to instances: 227de214-598c-4afa-ad15-9ddb51d56ca9 Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:58:55.823979 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:58:55.825637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:58:55.825637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:58:55.825637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:58:55.825637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 88cd93c3-c039-4a73-a876-b1094b91386a is already attached to instances: 227de214-598c-4afa-ad15-9ddb51d56ca9 Jun 21 16:58:55.825637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 16:58:55.825637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 400 to user: Invalid volume: volume 88cd93c3-c039-4a73-a876-b1094b91386a is already attached to instances: 227de214-598c-4afa-ad15-9ddb51d56ca9 {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:58:55.825637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5a9455c8-e8ce-4a46-931b-6fa5c268365e tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.156441 Jun 21 16:58:55.825637 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 487/995] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 16:58:55 2022] POST /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments => generated 174 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 16:58:55.881720 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:55.882887 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:58:55.887164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-88edb14e-ff8e-4ef3-9772-0294aee3bd52 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:55.887673 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-88edb14e-ff8e-4ef3-9772-0294aee3bd52 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:55.895269 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-88edb14e-ff8e-4ef3-9772-0294aee3bd52 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:55.899303 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-88edb14e-ff8e-4ef3-9772-0294aee3bd52 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:55.899303 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-88edb14e-ff8e-4ef3-9772-0294aee3bd52 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:55.899303 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-88edb14e-ff8e-4ef3-9772-0294aee3bd52 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:55.980801 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-88edb14e-ff8e-4ef3-9772-0294aee3bd52 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lazy-loading 'services' on Instance uuid 227de214-598c-4afa-ad15-9ddb51d56ca9 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:58:56.244354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-88edb14e-ff8e-4ef3-9772-0294aee3bd52 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments/88cd93c3-c039-4a73-a876-b1094b91386a" status: 202 len: 0 microversion: 2.1 time: 0.363850 Jun 21 16:58:56.245010 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 509/996] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 16:58:55 2022] DELETE /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments/88cd93c3-c039-4a73-a876-b1094b91386a => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:58:56.255562 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ecb2780b-c7f1-45fd-b1a6-f48a08cfd84d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:56.256494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ecb2780b-c7f1-45fd-b1a6-f48a08cfd84d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:56.265199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ecb2780b-c7f1-45fd-b1a6-f48a08cfd84d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:56.265678 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ecb2780b-c7f1-45fd-b1a6-f48a08cfd84d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:56.266464 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ecb2780b-c7f1-45fd-b1a6-f48a08cfd84d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:56.266892 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ecb2780b-c7f1-45fd-b1a6-f48a08cfd84d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:56.297529 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ecb2780b-c7f1-45fd-b1a6-f48a08cfd84d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047895 Jun 21 16:58:56.297891 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 488/997] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:58:56 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:58:57.080470 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-60e849d6-2316-4378-a37b-1d86552c17c9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:57.081937 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-60e849d6-2316-4378-a37b-1d86552c17c9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:57.089159 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-60e849d6-2316-4378-a37b-1d86552c17c9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:57.089159 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-60e849d6-2316-4378-a37b-1d86552c17c9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:57.089768 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-60e849d6-2316-4378-a37b-1d86552c17c9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:57.090209 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-60e849d6-2316-4378-a37b-1d86552c17c9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:57.175721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-60e849d6-2316-4378-a37b-1d86552c17c9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lazy-loading 'services' on Instance uuid fd479a87-25ae-4f57-b67f-ceaa4cab0944 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:58:57.310175 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3d82e58a-14a4-4a27-a2e9-686e2b454825 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:57.311057 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3d82e58a-14a4-4a27-a2e9-686e2b454825 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:57.317474 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d82e58a-14a4-4a27-a2e9-686e2b454825 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:57.317918 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d82e58a-14a4-4a27-a2e9-686e2b454825 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:57.318700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d82e58a-14a4-4a27-a2e9-686e2b454825 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:57.319114 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3d82e58a-14a4-4a27-a2e9-686e2b454825 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:57.348762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3d82e58a-14a4-4a27-a2e9-686e2b454825 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042533 Jun 21 16:58:57.349365 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 489/998] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 16:58:57 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 16:58:57.399331 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-60e849d6-2316-4378-a37b-1d86552c17c9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944/os-volume_attachments/edcf3d17-15d3-4362-8f6a-c7ffe381ebd5" status: 202 len: 0 microversion: 2.1 time: 0.323876 Jun 21 16:58:57.401253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 510/999] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 16:58:57 2022] DELETE /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944/os-volume_attachments/edcf3d17-15d3-4362-8f6a-c7ffe381ebd5 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:58:57.418881 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4b64570d-86a2-4c09-9cd0-416671d5d94a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:57.419376 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4b64570d-86a2-4c09-9cd0-416671d5d94a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:57.426024 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b64570d-86a2-4c09-9cd0-416671d5d94a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:57.426472 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b64570d-86a2-4c09-9cd0-416671d5d94a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:57.429949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b64570d-86a2-4c09-9cd0-416671d5d94a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:57.429949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4b64570d-86a2-4c09-9cd0-416671d5d94a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:57.453793 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4b64570d-86a2-4c09-9cd0-416671d5d94a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:58:57.821700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4b64570d-86a2-4c09-9cd0-416671d5d94a tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 204 len: 0 microversion: 2.1 time: 0.406665 Jun 21 16:58:57.822296 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 490/1000] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:58:57 2022] DELETE /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:58:57.831301 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f7c5c6d1-70af-4b40-bffd-9f45b9f9d982 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:57.835882 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f7c5c6d1-70af-4b40-bffd-9f45b9f9d982 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:57.838465 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f7c5c6d1-70af-4b40-bffd-9f45b9f9d982 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:57.838899 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f7c5c6d1-70af-4b40-bffd-9f45b9f9d982 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:57.839672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f7c5c6d1-70af-4b40-bffd-9f45b9f9d982 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:57.840110 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f7c5c6d1-70af-4b40-bffd-9f45b9f9d982 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:57.978303 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f7c5c6d1-70af-4b40-bffd-9f45b9f9d982 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:57.986407 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f7c5c6d1-70af-4b40-bffd-9f45b9f9d982 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1682 microversion: 2.1 time: 0.158959 Jun 21 16:58:57.986967 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 511/1001] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:57 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:58:59.004499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-75bffd9d-d2aa-478a-958b-9998f79ab421 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:58:59.005151 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-75bffd9d-d2aa-478a-958b-9998f79ab421 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:58:59.011919 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-75bffd9d-d2aa-478a-958b-9998f79ab421 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:59.012370 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-75bffd9d-d2aa-478a-958b-9998f79ab421 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:59.013132 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-75bffd9d-d2aa-478a-958b-9998f79ab421 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:58:59.013648 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-75bffd9d-d2aa-478a-958b-9998f79ab421 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:58:59.156911 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-75bffd9d-d2aa-478a-958b-9998f79ab421 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:58:59.165098 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-75bffd9d-d2aa-478a-958b-9998f79ab421 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1682 microversion: 2.1 time: 0.165354 Jun 21 16:58:59.168923 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 491/1002] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:58:58 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:00.183702 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9a0b143e-a0c1-49c2-8718-1867cbbc4426 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:00.185836 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-9a0b143e-a0c1-49c2-8718-1867cbbc4426 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:00.190848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9a0b143e-a0c1-49c2-8718-1867cbbc4426 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:00.191290 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9a0b143e-a0c1-49c2-8718-1867cbbc4426 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:00.192040 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9a0b143e-a0c1-49c2-8718-1867cbbc4426 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:00.192468 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-9a0b143e-a0c1-49c2-8718-1867cbbc4426 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:00.339744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-9a0b143e-a0c1-49c2-8718-1867cbbc4426 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:00.349906 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9a0b143e-a0c1-49c2-8718-1867cbbc4426 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1682 microversion: 2.1 time: 0.169994 Jun 21 16:59:00.350480 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 512/1003] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:00 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:00.561510 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-77972348-360f-4a4d-a3ec-ddc41a7a97cc req-8a9df3ad-5c81-407f-aba5-d6d139eaeedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227de214-598c-4afa-ad15-9ddb51d56ca9", "name": "network-vif-deleted", "tag": "036c8d2f-ef99-48d2-b631-53e8019c1724"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:59:00.573293 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-77972348-360f-4a4d-a3ec-ddc41a7a97cc req-8a9df3ad-5c81-407f-aba5-d6d139eaeedf service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:00.574081 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-77972348-360f-4a4d-a3ec-ddc41a7a97cc req-8a9df3ad-5c81-407f-aba5-d6d139eaeedf service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:00.588784 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-77972348-360f-4a4d-a3ec-ddc41a7a97cc req-8a9df3ad-5c81-407f-aba5-d6d139eaeedf service nova] Creating event network-vif-deleted:036c8d2f-ef99-48d2-b631-53e8019c1724 for instance 227de214-598c-4afa-ad15-9ddb51d56ca9 on hv-cinder-79987 Jun 21 16:59:00.603987 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-77972348-360f-4a4d-a3ec-ddc41a7a97cc req-8a9df3ad-5c81-407f-aba5-d6d139eaeedf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045875 Jun 21 16:59:00.604638 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 492/1004] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:59:00.649029 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-26afa65a-5c09-4e81-b3e9-2a51427dc96d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:00.652902 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-26afa65a-5c09-4e81-b3e9-2a51427dc96d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:00.656447 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-26afa65a-5c09-4e81-b3e9-2a51427dc96d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:00.657092 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-26afa65a-5c09-4e81-b3e9-2a51427dc96d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:00.659296 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-26afa65a-5c09-4e81-b3e9-2a51427dc96d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:00.659927 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-26afa65a-5c09-4e81-b3e9-2a51427dc96d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:00.692187 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-26afa65a-5c09-4e81-b3e9-2a51427dc96d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Going to try to terminate instance {{(pid=124685) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 16:59:01.062264 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-26afa65a-5c09-4e81-b3e9-2a51427dc96d tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 204 len: 0 microversion: 2.1 time: 0.418053 Jun 21 16:59:01.062941 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 513/1005] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 16:59:00 2022] DELETE /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 16:59:01.077477 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b782d054-2f3b-440a-987c-423efaf22558 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:01.078178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b782d054-2f3b-440a-987c-423efaf22558 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:01.084856 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b782d054-2f3b-440a-987c-423efaf22558 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:01.085322 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b782d054-2f3b-440a-987c-423efaf22558 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:01.086091 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b782d054-2f3b-440a-987c-423efaf22558 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:01.086526 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b782d054-2f3b-440a-987c-423efaf22558 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:01.229118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b782d054-2f3b-440a-987c-423efaf22558 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:01.237306 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b782d054-2f3b-440a-987c-423efaf22558 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1515 microversion: 2.1 time: 0.164260 Jun 21 16:59:01.237898 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 493/1006] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:01 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:01.368427 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:01.369138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:01.375907 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:01.376547 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:01.377357 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:01.377818 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:01.413848 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:01.414287 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:01.414752 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lazy-loading 'fault' on Instance uuid 227de214-598c-4afa-ad15-9ddb51d56ca9 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:59:01.459520 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:01.467128 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-572765e2-238c-45ee-bc09-77fc2f6ea186 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1331 microversion: 2.1 time: 0.103035 Jun 21 16:59:01.467699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 514/1007] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:01 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:02.254260 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a68440c2-beab-4fe9-9b60-bdc271b25ca9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:02.254925 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a68440c2-beab-4fe9-9b60-bdc271b25ca9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:02.261855 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a68440c2-beab-4fe9-9b60-bdc271b25ca9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:02.262456 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a68440c2-beab-4fe9-9b60-bdc271b25ca9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:02.263224 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a68440c2-beab-4fe9-9b60-bdc271b25ca9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:02.263667 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a68440c2-beab-4fe9-9b60-bdc271b25ca9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:02.394649 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a68440c2-beab-4fe9-9b60-bdc271b25ca9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:02.402119 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a68440c2-beab-4fe9-9b60-bdc271b25ca9 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1515 microversion: 2.1 time: 0.151881 Jun 21 16:59:02.402683 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 494/1008] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:02 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:02.484955 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:02.486126 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:02.492768 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:02.493255 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:02.494063 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:02.494685 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:02.527421 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:02.527894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:02.528343 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lazy-loading 'fault' on Instance uuid 227de214-598c-4afa-ad15-9ddb51d56ca9 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 16:59:02.569506 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:02.577034 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8ef7b27f-df7d-4ca8-bd73-f6a9576cbc49 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 200 len: 1331 microversion: 2.1 time: 0.096140 Jun 21 16:59:02.577628 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 515/1009] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:02 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:03.420949 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0dedb6ce-47f2-4dc1-ba22-e8395e9658ff tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:03.422330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0dedb6ce-47f2-4dc1-ba22-e8395e9658ff tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:03.432470 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0dedb6ce-47f2-4dc1-ba22-e8395e9658ff tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:03.433075 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0dedb6ce-47f2-4dc1-ba22-e8395e9658ff tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:03.434191 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0dedb6ce-47f2-4dc1-ba22-e8395e9658ff tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:03.434631 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0dedb6ce-47f2-4dc1-ba22-e8395e9658ff tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:03.489792 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-fd61ac11-3c48-48b9-afa6-33142cd1d21d req-52ba80b2-6c4f-4930-9946-4a4dfcb9473a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd479a87-25ae-4f57-b67f-ceaa4cab0944", "name": "network-vif-deleted", "tag": "52d0a763-bfbe-46fb-994d-eeff14264891"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:59:03.499384 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-fd61ac11-3c48-48b9-afa6-33142cd1d21d req-52ba80b2-6c4f-4930-9946-4a4dfcb9473a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:03.502290 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-fd61ac11-3c48-48b9-afa6-33142cd1d21d req-52ba80b2-6c4f-4930-9946-4a4dfcb9473a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:03.517028 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-fd61ac11-3c48-48b9-afa6-33142cd1d21d req-52ba80b2-6c4f-4930-9946-4a4dfcb9473a service nova] Creating event network-vif-deleted:52d0a763-bfbe-46fb-994d-eeff14264891 for instance fd479a87-25ae-4f57-b67f-ceaa4cab0944 on hv-cinder-79987 Jun 21 16:59:03.523696 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-fd61ac11-3c48-48b9-afa6-33142cd1d21d req-52ba80b2-6c4f-4930-9946-4a4dfcb9473a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038297 Jun 21 16:59:03.524288 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0dedb6ce-47f2-4dc1-ba22-e8395e9658ff tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc90b18a1f44d1eb1bba4e64fa1d3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dddfcc30ee8433c9f48d7153b416f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:03.524470 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 516/1010] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 16:59:03.534834 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0dedb6ce-47f2-4dc1-ba22-e8395e9658ff tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 200 len: 1473 microversion: 2.1 time: 0.119453 Jun 21 16:59:03.535490 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 495/1011] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:03 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 1473 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:03.595777 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:03.596844 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:03.607266 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:03.607705 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:03.610644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:03.610644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:03.627656 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 HTTP/1.1 Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:59:03.630156 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 16:59:03.631749 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '227de214-598c-4afa-ad15-9ddb51d56ca9'} Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:59:03.632827 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 16:59:03.634559 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:03.636220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:59:03.636220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e4c94d8f-2988-49bb-866e-751a1da49b86 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 404 len: 111 microversion: 2.1 time: 0.041239 Jun 21 16:59:03.636220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 517/1012] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:03 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:59:03.645777 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-91a902eb-ae43-4a52-8b48-38554a519b9d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '.version_select at 0x7f0a42a56040>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:03.766523 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-91a902eb-ae43-4a52-8b48-38554a519b9d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497487434" status: 202 len: 0 microversion: 2.1 time: 0.126863 Jun 21 16:59:03.767067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 496/1013] 10.222.0.70 () {58 vars in 1217 bytes} [Tue Jun 21 16:59:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497487434 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 16:59:04.558206 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:04.558828 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] [instance: fd479a87-25ae-4f57-b67f-ceaa4cab0944] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:04.567358 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:04.567967 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:04.568759 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:04.569187 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:04.583654 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] HTTP exception thrown: Instance fd479a87-25ae-4f57-b67f-ceaa4cab0944 could not be found. Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Request method failure captured: Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 HTTP/1.1 Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfhZxsWkpnq_wupfAU4UQa-L0v-AO0VuFcaYDcmUMGYpnMK6bqeCzjEKHHtZ0ofWzhBeoyqTlUEMJTs4-r2zkWMJ44ewIUDtzgkjodEyMKZxclE5rGuvB1FnekTEz8zV0Zub-cezGRYumm1d1tm-TwkmTawW-KFUFJ-EOwCMsFEiqkY Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 7dddfcc30ee8433c9f48d7153b416f21 Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1970342923 Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 16:59:04.585760 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7dddfcc30ee8433c9f48d7153b416f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7dddfcc30ee8433c9f48d7153b416f21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7dddfcc30ee8433c9f48d7153b416f21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7dddfcc30ee8433c9f48d7153b416f21", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-VolumesSnapshotTestJSON-1970342923 Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 7dddfcc30ee8433c9f48d7153b416f21 Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1970342923 Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-VolumesSnapshotTestJSON-1970342923-project Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: dfc90b18a1f44d1eb1bba4e64fa1d3a1 Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-VolumesSnapshotTestJSON-1970342923-project Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance fd479a87-25ae-4f57-b67f-ceaa4cab0944 could not be found. Jun 21 16:59:04.589868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': 'fd479a87-25ae-4f57-b67f-ceaa4cab0944'} Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd479a87-25ae-4f57-b67f-ceaa4cab0944 could not be found. Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 16:59:04.590920 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd479a87-25ae-4f57-b67f-ceaa4cab0944 could not be found. Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd479a87-25ae-4f57-b67f-ceaa4cab0944 could not be found. Jun 21 16:59:04.592309 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 16:59:04.593524 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] Returning 404 to user: Instance fd479a87-25ae-4f57-b67f-ceaa4cab0944 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 16:59:04.593524 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b53d6fb6-564e-4c5f-a045-7dc74af05c43 tempest-VolumesSnapshotTestJSON-1970342923 tempest-VolumesSnapshotTestJSON-1970342923-project] 10.222.0.70 "GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944" status: 404 len: 111 microversion: 2.1 time: 0.033554 Jun 21 16:59:04.593524 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 518/1014] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:04 2022] GET /compute/v2.1/servers/fd479a87-25ae-4f57-b67f-ceaa4cab0944 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 16:59:04.595422 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6d57f5c9-f5c4-498e-a7c9-c2f8abdb8989 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: .version_select at 0x7f0a42a1fee0>, body: {"keypair": {"name": "tempest-keypair-1003255248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlHPqZQgD+wnEvoiHYjqDNZfPmJtmqNEauVPJO40H1rzOjFyYxeyDnbaLp/an9lT1S3zNAFw0WdTu5E1gDmTqoXM0s24/BNQPn/cFwUpUWtad5O4j8paR+qRyS5Z24DAw=="}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:59:04.617875 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-6d57f5c9-f5c4-498e-a7c9-c2f8abdb8989 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:59:04.621953 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-6d57f5c9-f5c4-498e-a7c9-c2f8abdb8989 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for user 8d1c7f32f0624210ae0ba52c022fea5a and project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:59:04.731774 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6d57f5c9-f5c4-498e-a7c9-c2f8abdb8989 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140390 Jun 21 16:59:04.732427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 497/1015] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 16:59:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:59:07.253270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-864723950", "imageRef": "0326fa11-e4c9-4885-9ff2-0ae96af5050b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83741c3b-7ff0-4b33-b398-e82b72fea3bd"}], "security_groups": [{"name": "tempest-securitygroup--155601863"}], "key_name": "tempest-keypair-1003255248", "user_data": "}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:59:07.358765 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] validate_networks() for [('83741c3b-7ff0-4b33-b398-e82b72fea3bd', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 16:59:07.742532 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 16:59:07.742999 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 16:59:07.743506 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 16:59:07.743918 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 16:59:07.744437 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 16:59:07.754469 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:07.754919 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:07.755717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:07.756151 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:07.775589 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 16:59:07.779881 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Getting quotas for user 8d1c7f32f0624210ae0ba52c022fea5a and project 97cafcd59ef1433ba71a47a01b3a331c. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 16:59:07.792041 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 16:59:07.794388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0326fa11-e4c9-4885-9ff2-0ae96af5050b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 16:59:07.967056 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-c2e59114-cc2a-41df-9f70-0ffdf08f27f8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.718306 Jun 21 16:59:07.967669 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 519/1016] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 16:59:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 16:59:07.978201 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0da13984-3f8f-45af-ba96-8bb46d45afd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:07.978815 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0da13984-3f8f-45af-ba96-8bb46d45afd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:08.034828 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-0da13984-3f8f-45af-ba96-8bb46d45afd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:08.041684 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0da13984-3f8f-45af-ba96-8bb46d45afd1 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1241 microversion: 2.1 time: 0.067613 Jun 21 16:59:08.042400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 498/1017] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:07 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:09.059925 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6bedb9f4-56a4-4040-b76d-b31a07f3fd23 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:09.060538 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6bedb9f4-56a4-4040-b76d-b31a07f3fd23 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:09.067730 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6bedb9f4-56a4-4040-b76d-b31a07f3fd23 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:09.068188 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6bedb9f4-56a4-4040-b76d-b31a07f3fd23 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:09.068986 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6bedb9f4-56a4-4040-b76d-b31a07f3fd23 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:09.069472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6bedb9f4-56a4-4040-b76d-b31a07f3fd23 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:09.132910 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6bedb9f4-56a4-4040-b76d-b31a07f3fd23 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:09.140643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6bedb9f4-56a4-4040-b76d-b31a07f3fd23 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1245 microversion: 2.1 time: 0.085242 Jun 21 16:59:09.141122 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 520/1018] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:09 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:10.158499 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-83898c8c-44b7-43b0-963e-eb587ffa9117 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:10.159095 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-83898c8c-44b7-43b0-963e-eb587ffa9117 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:10.165763 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-83898c8c-44b7-43b0-963e-eb587ffa9117 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:10.166217 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-83898c8c-44b7-43b0-963e-eb587ffa9117 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:10.167015 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-83898c8c-44b7-43b0-963e-eb587ffa9117 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:10.167473 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-83898c8c-44b7-43b0-963e-eb587ffa9117 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:10.230178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-83898c8c-44b7-43b0-963e-eb587ffa9117 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:10.237890 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-83898c8c-44b7-43b0-963e-eb587ffa9117 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1245 microversion: 2.1 time: 0.083652 Jun 21 16:59:10.238459 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 499/1019] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:10 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:11.255807 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8c8f1a17-4098-4275-b21f-b15e1ef13937 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:11.256452 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8c8f1a17-4098-4275-b21f-b15e1ef13937 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:11.263535 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c8f1a17-4098-4275-b21f-b15e1ef13937 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:11.264022 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c8f1a17-4098-4275-b21f-b15e1ef13937 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:11.264852 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c8f1a17-4098-4275-b21f-b15e1ef13937 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:11.265520 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8c8f1a17-4098-4275-b21f-b15e1ef13937 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:11.338486 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8c8f1a17-4098-4275-b21f-b15e1ef13937 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:11.347498 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8c8f1a17-4098-4275-b21f-b15e1ef13937 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1301 microversion: 2.1 time: 0.096376 Jun 21 16:59:11.351803 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 521/1020] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:11 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:12.365924 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-94bf72a6-f62c-42e8-93e2-747e191bad00 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:12.366604 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-94bf72a6-f62c-42e8-93e2-747e191bad00 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:12.372933 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-94bf72a6-f62c-42e8-93e2-747e191bad00 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:12.373472 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-94bf72a6-f62c-42e8-93e2-747e191bad00 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:12.374265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-94bf72a6-f62c-42e8-93e2-747e191bad00 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:12.374707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-94bf72a6-f62c-42e8-93e2-747e191bad00 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:12.564950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-94bf72a6-f62c-42e8-93e2-747e191bad00 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:12.574242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-94bf72a6-f62c-42e8-93e2-747e191bad00 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1366 microversion: 2.1 time: 0.212445 Jun 21 16:59:12.574824 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 500/1021] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:12 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:13.591316 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b96e76a3-fb0d-4ac0-a11c-d1a766c47042 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:13.591999 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b96e76a3-fb0d-4ac0-a11c-d1a766c47042 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:13.602844 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-446815e4-a91d-4e0f-8e7d-12067519d239 req-f8673365-09ba-41a2-bfa8-d50f381d0bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d", "tag": "e2c15a0f-254c-46c0-86c6-6a66c028007e"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:59:13.604786 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b96e76a3-fb0d-4ac0-a11c-d1a766c47042 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:13.605240 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b96e76a3-fb0d-4ac0-a11c-d1a766c47042 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:13.606051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b96e76a3-fb0d-4ac0-a11c-d1a766c47042 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:13.606669 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b96e76a3-fb0d-4ac0-a11c-d1a766c47042 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:13.611444 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-446815e4-a91d-4e0f-8e7d-12067519d239 req-f8673365-09ba-41a2-bfa8-d50f381d0bd7 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:13.611887 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-446815e4-a91d-4e0f-8e7d-12067519d239 req-f8673365-09ba-41a2-bfa8-d50f381d0bd7 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:13.623491 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-446815e4-a91d-4e0f-8e7d-12067519d239 req-f8673365-09ba-41a2-bfa8-d50f381d0bd7 service nova] Creating event network-changed:e2c15a0f-254c-46c0-86c6-6a66c028007e for instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d on hv-cinder-79987 Jun 21 16:59:13.629160 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-446815e4-a91d-4e0f-8e7d-12067519d239 req-f8673365-09ba-41a2-bfa8-d50f381d0bd7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096784 Jun 21 16:59:13.629763 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 522/1022] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:59:13.850451 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b96e76a3-fb0d-4ac0-a11c-d1a766c47042 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:13.857904 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b96e76a3-fb0d-4ac0-a11c-d1a766c47042 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1366 microversion: 2.1 time: 0.270337 Jun 21 16:59:13.858522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 501/1023] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:13 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:59:14.876033 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b4a11836-13d5-471b-9347-723986779622 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:14.876771 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b4a11836-13d5-471b-9347-723986779622 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:14.883763 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b4a11836-13d5-471b-9347-723986779622 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:14.884241 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b4a11836-13d5-471b-9347-723986779622 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:14.885029 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b4a11836-13d5-471b-9347-723986779622 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:14.885507 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b4a11836-13d5-471b-9347-723986779622 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:15.028708 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b4a11836-13d5-471b-9347-723986779622 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:15.037586 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b4a11836-13d5-471b-9347-723986779622 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1366 microversion: 2.1 time: 0.166330 Jun 21 16:59:15.038226 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 523/1024] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:14 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:16.060107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-768e5170-ecb3-46bc-adac-8197e2dd029c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:16.060107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-768e5170-ecb3-46bc-adac-8197e2dd029c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:16.069048 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-768e5170-ecb3-46bc-adac-8197e2dd029c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:16.069820 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-768e5170-ecb3-46bc-adac-8197e2dd029c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:16.070685 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-768e5170-ecb3-46bc-adac-8197e2dd029c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:16.071497 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-768e5170-ecb3-46bc-adac-8197e2dd029c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:16.227157 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-768e5170-ecb3-46bc-adac-8197e2dd029c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:16.235237 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-768e5170-ecb3-46bc-adac-8197e2dd029c tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1366 microversion: 2.1 time: 0.183910 Jun 21 16:59:16.235917 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 502/1025] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:16 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 16:59:17.259702 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8da3c6a4-c83f-428b-9395-d5de8f750b32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:17.260318 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8da3c6a4-c83f-428b-9395-d5de8f750b32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:17.267995 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8da3c6a4-c83f-428b-9395-d5de8f750b32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:17.268449 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8da3c6a4-c83f-428b-9395-d5de8f750b32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:17.269236 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8da3c6a4-c83f-428b-9395-d5de8f750b32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:17.269708 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8da3c6a4-c83f-428b-9395-d5de8f750b32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:17.400029 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8da3c6a4-c83f-428b-9395-d5de8f750b32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:17.407434 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8da3c6a4-c83f-428b-9395-d5de8f750b32 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1366 microversion: 2.1 time: 0.152040 Jun 21 16:59:17.407993 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 524/1026] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:17 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:18.423952 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-959c1781-4d14-4651-91fc-3c00afc25453 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:18.424554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-959c1781-4d14-4651-91fc-3c00afc25453 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:18.427058 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=6 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:18.431934 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-959c1781-4d14-4651-91fc-3c00afc25453 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:18.438229 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-959c1781-4d14-4651-91fc-3c00afc25453 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:18.438229 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-959c1781-4d14-4651-91fc-3c00afc25453 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:18.438229 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-959c1781-4d14-4651-91fc-3c00afc25453 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:18.562630 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-959c1781-4d14-4651-91fc-3c00afc25453 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:18.571138 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-959c1781-4d14-4651-91fc-3c00afc25453 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1366 microversion: 2.1 time: 0.151062 Jun 21 16:59:18.577730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 503/1027] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:18 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:18.656601 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:18.657381 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=6 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:18.662551 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-367f204c-20c1-42f7-adf0-fbfde65efa1b req-a2296827-c3bd-4556-9c41-66e34eb3440c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d", "name": "network-vif-plugged", "status": "completed", "tag": "e2c15a0f-254c-46c0-86c6-6a66c028007e"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:59:18.670450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-367f204c-20c1-42f7-adf0-fbfde65efa1b req-a2296827-c3bd-4556-9c41-66e34eb3440c service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:18.679032 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-367f204c-20c1-42f7-adf0-fbfde65efa1b req-a2296827-c3bd-4556-9c41-66e34eb3440c service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:18.679032 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:18.682575 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-367f204c-20c1-42f7-adf0-fbfde65efa1b req-a2296827-c3bd-4556-9c41-66e34eb3440c service nova] Creating event network-vif-plugged:e2c15a0f-254c-46c0-86c6-6a66c028007e for instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d on hv-cinder-79987 Jun 21 16:59:18.687337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-367f204c-20c1-42f7-adf0-fbfde65efa1b req-a2296827-c3bd-4556-9c41-66e34eb3440c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031439 Jun 21 16:59:18.687935 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 525/1028] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:59:19.588607 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-084fa7ce-6c44-4dc0-9dc6-8d10e3be02c6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:19.589168 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-084fa7ce-6c44-4dc0-9dc6-8d10e3be02c6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:19.595907 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-084fa7ce-6c44-4dc0-9dc6-8d10e3be02c6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:19.596564 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-084fa7ce-6c44-4dc0-9dc6-8d10e3be02c6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:19.597377 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-084fa7ce-6c44-4dc0-9dc6-8d10e3be02c6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:19.597813 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-084fa7ce-6c44-4dc0-9dc6-8d10e3be02c6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:19.732034 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-084fa7ce-6c44-4dc0-9dc6-8d10e3be02c6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:19.740024 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-084fa7ce-6c44-4dc0-9dc6-8d10e3be02c6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1366 microversion: 2.1 time: 0.155765 Jun 21 16:59:19.740594 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 504/1029] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:19 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:20.758019 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-badf44e6-81de-47fd-90dc-0dae02cd7196 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:20.758747 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-badf44e6-81de-47fd-90dc-0dae02cd7196 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:20.767229 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-badf44e6-81de-47fd-90dc-0dae02cd7196 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:20.767712 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-badf44e6-81de-47fd-90dc-0dae02cd7196 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:20.768473 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-badf44e6-81de-47fd-90dc-0dae02cd7196 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:20.768908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-badf44e6-81de-47fd-90dc-0dae02cd7196 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:20.904927 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-badf44e6-81de-47fd-90dc-0dae02cd7196 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:20.913129 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-badf44e6-81de-47fd-90dc-0dae02cd7196 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1366 microversion: 2.1 time: 0.160894 Jun 21 16:59:20.913877 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 526/1030] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:20 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:21.931379 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b7ff6544-e4cb-4a0f-8f57-bf36bd83da8f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:21.932127 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-b7ff6544-e4cb-4a0f-8f57-bf36bd83da8f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:21.938519 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b7ff6544-e4cb-4a0f-8f57-bf36bd83da8f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:21.939000 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b7ff6544-e4cb-4a0f-8f57-bf36bd83da8f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:21.939752 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b7ff6544-e4cb-4a0f-8f57-bf36bd83da8f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:21.940178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-b7ff6544-e4cb-4a0f-8f57-bf36bd83da8f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:21.960204 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:59:22.081681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-b7ff6544-e4cb-4a0f-8f57-bf36bd83da8f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:22.089092 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b7ff6544-e4cb-4a0f-8f57-bf36bd83da8f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1366 microversion: 2.1 time: 0.162753 Jun 21 16:59:22.089685 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 505/1031] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:21 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:23.106380 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-edf5270f-e7ad-4e6f-b8d8-6a4712339dd8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:23.107119 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-edf5270f-e7ad-4e6f-b8d8-6a4712339dd8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:23.113649 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-edf5270f-e7ad-4e6f-b8d8-6a4712339dd8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:23.114098 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-edf5270f-e7ad-4e6f-b8d8-6a4712339dd8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:23.114862 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-edf5270f-e7ad-4e6f-b8d8-6a4712339dd8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:23.115320 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-edf5270f-e7ad-4e6f-b8d8-6a4712339dd8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:23.257429 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-edf5270f-e7ad-4e6f-b8d8-6a4712339dd8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 16:59:23.265406 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-edf5270f-e7ad-4e6f-b8d8-6a4712339dd8 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1556 microversion: 2.1 time: 0.162848 Jun 21 16:59:23.273650 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 527/1032] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 16:59:23 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 16:59:23.282882 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-5c86a62c-97ac-4bd0-a65d-f5ee81428e2b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 16:59:23.283432 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-5c86a62c-97ac-4bd0-a65d-f5ee81428e2b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 16:59:23.290614 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5c86a62c-97ac-4bd0-a65d-f5ee81428e2b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:23.291090 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5c86a62c-97ac-4bd0-a65d-f5ee81428e2b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:23.291859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5c86a62c-97ac-4bd0-a65d-f5ee81428e2b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:23.292294 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-5c86a62c-97ac-4bd0-a65d-f5ee81428e2b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:23.372036 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-5c86a62c-97ac-4bd0-a65d-f5ee81428e2b tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093188 Jun 21 16:59:23.372668 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 506/1033] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jun 21 16:59:23 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 16:59:24.409261 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-c6e8c024-27ac-4f17-96c6-a60409b94b83 req-48f8ed42-99a7-491e-a3c8-1b623df1a198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d", "tag": "e2c15a0f-254c-46c0-86c6-6a66c028007e"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 16:59:24.418200 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-c6e8c024-27ac-4f17-96c6-a60409b94b83 req-48f8ed42-99a7-491e-a3c8-1b623df1a198 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 16:59:24.418746 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-c6e8c024-27ac-4f17-96c6-a60409b94b83 req-48f8ed42-99a7-491e-a3c8-1b623df1a198 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 16:59:24.430065 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-c6e8c024-27ac-4f17-96c6-a60409b94b83 req-48f8ed42-99a7-491e-a3c8-1b623df1a198 service nova] Creating event network-changed:e2c15a0f-254c-46c0-86c6-6a66c028007e for instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d on hv-cinder-79987 Jun 21 16:59:24.434995 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-c6e8c024-27ac-4f17-96c6-a60409b94b83 req-48f8ed42-99a7-491e-a3c8-1b623df1a198 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029414 Jun 21 16:59:24.435651 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 528/1034] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 16:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:02.261111 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a3528d52-a675-4837-8bec-76a96834f148 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:02.263092 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a3528d52-a675-4837-8bec-76a96834f148 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:02.280420 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:02.282086 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=14 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:02.287419 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:02.288855 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-f4ad5fbe-d687-45b6-96c2-5fde33308f6c req-a415e9de-68ac-4911-ad95-cc2df86458d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc11023-ceb3-4f72-83d3-a4ea95eb2863", "tag": "711a0b2d-04b6-4f67-8f42-73102320e7af"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:02.289652 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=6 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:02.291366 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a3528d52-a675-4837-8bec-76a96834f148 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:02.292001 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a3528d52-a675-4837-8bec-76a96834f148 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:02.293196 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a3528d52-a675-4837-8bec-76a96834f148 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:02.293929 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a3528d52-a675-4837-8bec-76a96834f148 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:02.304545 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-f4ad5fbe-d687-45b6-96c2-5fde33308f6c req-a415e9de-68ac-4911-ad95-cc2df86458d3 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:02.305272 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-f4ad5fbe-d687-45b6-96c2-5fde33308f6c req-a415e9de-68ac-4911-ad95-cc2df86458d3 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:02.320678 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-f4ad5fbe-d687-45b6-96c2-5fde33308f6c req-a415e9de-68ac-4911-ad95-cc2df86458d3 service nova] Creating event network-changed:711a0b2d-04b6-4f67-8f42-73102320e7af for instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 on hv-cinder-79987 Jun 21 17:00:02.327796 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-f4ad5fbe-d687-45b6-96c2-5fde33308f6c req-a415e9de-68ac-4911-ad95-cc2df86458d3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048621 Jun 21 17:00:02.329171 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 529/1035] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:02.333658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a3528d52-a675-4837-8bec-76a96834f148 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 17:00:02.690809 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a3528d52-a675-4837-8bec-76a96834f148 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 204 len: 0 microversion: 2.1 time: 0.433989 Jun 21 17:00:02.691710 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 507/1036] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 17:00:02 2022] DELETE /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 17:00:02.706695 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a2eac1ff-2d22-4862-bbad-b651fafd8df0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:02.707353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a2eac1ff-2d22-4862-bbad-b651fafd8df0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:02.723744 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2eac1ff-2d22-4862-bbad-b651fafd8df0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:02.727064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2eac1ff-2d22-4862-bbad-b651fafd8df0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:02.727064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2eac1ff-2d22-4862-bbad-b651fafd8df0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:02.727064 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2eac1ff-2d22-4862-bbad-b651fafd8df0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:03.008046 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a2eac1ff-2d22-4862-bbad-b651fafd8df0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:03.034697 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a2eac1ff-2d22-4862-bbad-b651fafd8df0 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1578 microversion: 2.1 time: 0.338034 Jun 21 17:00:03.036206 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 530/1037] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:02 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1578 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:04.053802 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-15f2265e-6b08-422b-93e7-dc44e28cbd61 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:04.055199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-15f2265e-6b08-422b-93e7-dc44e28cbd61 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:04.063918 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15f2265e-6b08-422b-93e7-dc44e28cbd61 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:04.064623 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15f2265e-6b08-422b-93e7-dc44e28cbd61 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:04.067577 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15f2265e-6b08-422b-93e7-dc44e28cbd61 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:04.067577 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15f2265e-6b08-422b-93e7-dc44e28cbd61 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:04.352319 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-15f2265e-6b08-422b-93e7-dc44e28cbd61 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:04.361167 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-15f2265e-6b08-422b-93e7-dc44e28cbd61 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1578 microversion: 2.1 time: 0.311672 Jun 21 17:00:04.361856 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 508/1038] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:04 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1578 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:05.083197 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-0e44b5f0-5a5d-49f5-9c29-f4effa615108 req-c87088db-f509-43b6-87a5-5eeeff8c2d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc11023-ceb3-4f72-83d3-a4ea95eb2863", "name": "network-vif-deleted", "tag": "711a0b2d-04b6-4f67-8f42-73102320e7af"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:05.093379 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-0e44b5f0-5a5d-49f5-9c29-f4effa615108 req-c87088db-f509-43b6-87a5-5eeeff8c2d9e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:05.093833 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-0e44b5f0-5a5d-49f5-9c29-f4effa615108 req-c87088db-f509-43b6-87a5-5eeeff8c2d9e service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:05.106063 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-0e44b5f0-5a5d-49f5-9c29-f4effa615108 req-c87088db-f509-43b6-87a5-5eeeff8c2d9e service nova] Creating event network-vif-deleted:711a0b2d-04b6-4f67-8f42-73102320e7af for instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 on hv-cinder-79987 Jun 21 17:00:05.111135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-0e44b5f0-5a5d-49f5-9c29-f4effa615108 req-c87088db-f509-43b6-87a5-5eeeff8c2d9e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032840 Jun 21 17:00:05.111733 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 531/1039] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:05.381708 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8e72764e-6303-4369-bed5-b90688c3a6bb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:05.383037 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8e72764e-6303-4369-bed5-b90688c3a6bb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:05.394323 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e72764e-6303-4369-bed5-b90688c3a6bb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:05.395242 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e72764e-6303-4369-bed5-b90688c3a6bb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:05.396537 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e72764e-6303-4369-bed5-b90688c3a6bb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:05.397360 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e72764e-6303-4369-bed5-b90688c3a6bb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:05.506545 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8e72764e-6303-4369-bed5-b90688c3a6bb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:05.530271 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8e72764e-6303-4369-bed5-b90688c3a6bb tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1226 microversion: 2.1 time: 0.154358 Jun 21 17:00:05.538197 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 509/1040] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:05 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1226 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:06.554280 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:06.557325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:06.565269 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:06.566186 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:06.567386 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:06.567930 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:06.633372 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:06.633875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:06.634335 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lazy-loading 'fault' on Instance uuid 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 17:00:06.803868 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:06.826487 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-74b50a81-b382-44e2-ad42-a226e414ba8f tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 200 len: 1185 microversion: 2.1 time: 0.264741 Jun 21 17:00:06.826487 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 532/1041] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:06 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 1185 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:07.837056 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:07.837704 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: 6bc11023-ceb3-4f72-83d3-a4ea95eb2863] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:07.846338 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:07.847182 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:07.848806 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:07.849636 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:07.872475 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] HTTP exception thrown: Instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 could not be found. Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Request method failure captured: Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 HTTP/1.1 Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfc6mLtJWhgynj42LzZ-zWY63rQIWwprMnpkRdQI4LsmxukSe55XHPfLk8nJMo1S4O10_tuQsmwIFd6xIuAWjy4RKkNV7hHolZVFwtnVF4VVieX0JM9DlTTyFk5Z3rQ4rgCMJ48OkhhWCJjeUl-ttjC2uv5L9Nm9Bk3-LS5oSa9ZpPU Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 17:00:07.874330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7a8a0ae0c16a41c8b34547406830813a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-TestVolumeBootPattern-415641267-project Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 0ebe6382afe24ef489261081e8610271 Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-TestVolumeBootPattern-415641267-project Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 could not be found. Jun 21 17:00:07.875973 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '6bc11023-ceb3-4f72-83d3-a4ea95eb2863'} Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 could not be found. Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:07.877865 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 could not be found. Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 could not be found. Jun 21 17:00:07.879608 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:07.881519 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Returning 404 to user: Instance 6bc11023-ceb3-4f72-83d3-a4ea95eb2863 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:07.881519 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f91fcd60-9491-40bd-b190-ca1c9375cd7a tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863" status: 404 len: 111 microversion: 2.1 time: 0.042896 Jun 21 17:00:07.881519 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 510/1042] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:07 2022] GET /compute/v2.1/servers/6bc11023-ceb3-4f72-83d3-a4ea95eb2863 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:08.635901 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3b73188e-8120-4249-8044-f067f433aae0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:08.637042 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3b73188e-8120-4249-8044-f067f433aae0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:08.643618 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b73188e-8120-4249-8044-f067f433aae0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:08.644347 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b73188e-8120-4249-8044-f067f433aae0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:08.651416 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b73188e-8120-4249-8044-f067f433aae0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:08.651416 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3b73188e-8120-4249-8044-f067f433aae0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:08.672649 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3b73188e-8120-4249-8044-f067f433aae0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/ips" status: 200 len: 150 microversion: 2.1 time: 0.357661 Jun 21 17:00:08.673212 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 533/1043] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jun 21 17:00:08 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/ips => generated 150 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:10.337415 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f8feb618-eb3a-4f16-bff9-9c9aeb599783 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29d6905c-cefc-4662-aafe-23353119f527"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:10.338567 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f8feb618-eb3a-4f16-bff9-9c9aeb599783 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:10.345878 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8feb618-eb3a-4f16-bff9-9c9aeb599783 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:10.346330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8feb618-eb3a-4f16-bff9-9c9aeb599783 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:10.347119 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8feb618-eb3a-4f16-bff9-9c9aeb599783 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:10.347734 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f8feb618-eb3a-4f16-bff9-9c9aeb599783 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:11.421767 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f8feb618-eb3a-4f16-bff9-9c9aeb599783 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "POST /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.088219 Jun 21 17:00:11.424504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 511/1044] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 17:00:10 2022] POST /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-volume_attachments => generated 194 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:11.670968 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fc0eb924-fc3c-411c-b5b4-115aa8229515 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:11.681632 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fc0eb924-fc3c-411c-b5b4-115aa8229515 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:11.687355 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-16ae5986-64ef-4dee-b8b1-ffb0773694c7 req-880bff57-8054-4613-aee8-c214cf28674a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdcabcd-b09e-4215-9fd3-914201278c7d", "tag": "b654ed50-66dd-4643-897e-9f5c0d189bff"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:11.696942 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc0eb924-fc3c-411c-b5b4-115aa8229515 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:11.697415 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc0eb924-fc3c-411c-b5b4-115aa8229515 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:11.698571 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc0eb924-fc3c-411c-b5b4-115aa8229515 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:11.699842 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fc0eb924-fc3c-411c-b5b4-115aa8229515 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:11.703504 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-16ae5986-64ef-4dee-b8b1-ffb0773694c7 req-880bff57-8054-4613-aee8-c214cf28674a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:11.726750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-16ae5986-64ef-4dee-b8b1-ffb0773694c7 req-880bff57-8054-4613-aee8-c214cf28674a service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:11.726750 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-16ae5986-64ef-4dee-b8b1-ffb0773694c7 req-880bff57-8054-4613-aee8-c214cf28674a service nova] Creating event network-changed:b654ed50-66dd-4643-897e-9f5c0d189bff for instance ebdcabcd-b09e-4215-9fd3-914201278c7d on hv-cinder-79987 Jun 21 17:00:11.729085 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-16ae5986-64ef-4dee-b8b1-ffb0773694c7 req-880bff57-8054-4613-aee8-c214cf28674a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048156 Jun 21 17:00:11.731349 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 512/1045] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 17:00:11.740204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fc0eb924-fc3c-411c-b5b4-115aa8229515 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Going to try to terminate instance {{(pid=124685) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 17:00:12.249895 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fc0eb924-fc3c-411c-b5b4-115aa8229515 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 204 len: 0 microversion: 2.1 time: 0.584887 Jun 21 17:00:12.260452 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-96ead609-497b-4ce2-a788-c7f4ba7da7a8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:12.260837 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 534/1046] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 17:00:11 2022] DELETE /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 17:00:12.262740 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-96ead609-497b-4ce2-a788-c7f4ba7da7a8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:12.278554 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-96ead609-497b-4ce2-a788-c7f4ba7da7a8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:12.282947 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-96ead609-497b-4ce2-a788-c7f4ba7da7a8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:12.288839 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-96ead609-497b-4ce2-a788-c7f4ba7da7a8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:12.289734 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-96ead609-497b-4ce2-a788-c7f4ba7da7a8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:12.535827 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-96ead609-497b-4ce2-a788-c7f4ba7da7a8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:12.543715 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-96ead609-497b-4ce2-a788-c7f4ba7da7a8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1577 microversion: 2.1 time: 0.287952 Jun 21 17:00:12.544292 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 513/1047] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:12 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1577 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:13.565344 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3f273af6-a989-4826-a662-bc0d805139cc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:13.566806 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3f273af6-a989-4826-a662-bc0d805139cc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:13.587566 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f273af6-a989-4826-a662-bc0d805139cc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:13.590500 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f273af6-a989-4826-a662-bc0d805139cc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:13.591556 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f273af6-a989-4826-a662-bc0d805139cc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:13.592167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3f273af6-a989-4826-a662-bc0d805139cc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:13.775805 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-3f273af6-a989-4826-a662-bc0d805139cc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:13.785465 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3f273af6-a989-4826-a662-bc0d805139cc tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1577 microversion: 2.1 time: 0.224208 Jun 21 17:00:13.791977 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 535/1048] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:13 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:14.527408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-d0d437f9-477f-4854-a9c6-6db8b22066c9 req-69515f0b-5b16-48a9-9e48-5ef93df08a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdcabcd-b09e-4215-9fd3-914201278c7d", "name": "network-vif-deleted", "tag": "b654ed50-66dd-4643-897e-9f5c0d189bff"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:14.544025 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-d0d437f9-477f-4854-a9c6-6db8b22066c9 req-69515f0b-5b16-48a9-9e48-5ef93df08a71 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:14.544839 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-d0d437f9-477f-4854-a9c6-6db8b22066c9 req-69515f0b-5b16-48a9-9e48-5ef93df08a71 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:14.576560 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-d0d437f9-477f-4854-a9c6-6db8b22066c9 req-69515f0b-5b16-48a9-9e48-5ef93df08a71 service nova] Creating event network-vif-deleted:b654ed50-66dd-4643-897e-9f5c0d189bff for instance ebdcabcd-b09e-4215-9fd3-914201278c7d on hv-cinder-79987 Jun 21 17:00:14.586658 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-d0d437f9-477f-4854-a9c6-6db8b22066c9 req-69515f0b-5b16-48a9-9e48-5ef93df08a71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064869 Jun 21 17:00:14.587593 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 514/1049] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:14.808167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f2ff8e81-d400-4e84-9eee-2efa0f3ba03c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:14.808785 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f2ff8e81-d400-4e84-9eee-2efa0f3ba03c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:14.816323 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f2ff8e81-d400-4e84-9eee-2efa0f3ba03c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:14.816898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f2ff8e81-d400-4e84-9eee-2efa0f3ba03c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:14.817703 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f2ff8e81-d400-4e84-9eee-2efa0f3ba03c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:14.821155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f2ff8e81-d400-4e84-9eee-2efa0f3ba03c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:14.933668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f2ff8e81-d400-4e84-9eee-2efa0f3ba03c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:14.933668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f2ff8e81-d400-4e84-9eee-2efa0f3ba03c tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1225 microversion: 2.1 time: 0.115553 Jun 21 17:00:14.933668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 536/1050] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:14 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:15.942491 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:15.943308 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:15.957482 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:15.957929 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:15.958709 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:15.962353 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:16.025381 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:16.026092 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:16.027270 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.objects.instance [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lazy-loading 'fault' on Instance uuid ebdcabcd-b09e-4215-9fd3-914201278c7d {{(pid=124686) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 17:00:16.114820 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebe6382afe24ef489261081e8610271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8a0ae0c16a41c8b34547406830813a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:16.129569 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-9df68073-5762-4ebf-8ff8-957951b585d3 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 200 len: 1230 microversion: 2.1 time: 0.192951 Jun 21 17:00:16.131096 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 515/1051] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:15 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 1230 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:17.147898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:17.149165 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: ebdcabcd-b09e-4215-9fd3-914201278c7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:17.160717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:17.163254 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:17.165441 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:17.165903 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:17.191404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] HTTP exception thrown: Instance ebdcabcd-b09e-4215-9fd3-914201278c7d could not be found. Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Request method failure captured: Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d HTTP/1.1 Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfc6mLtJWhgynj42LzZ-zWY63rQIWwprMnpkRdQI4LsmxukSe55XHPfLk8nJMo1S4O10_tuQsmwIFd6xIuAWjy4RKkNV7hHolZVFwtnVF4VVieX0JM9DlTTyFk5Z3rQ4rgCMJ48OkhhWCJjeUl-ttjC2uv5L9Nm9Bk3-LS5oSa9ZpPU Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 17:00:17.193794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7a8a0ae0c16a41c8b34547406830813a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-TestVolumeBootPattern-415641267-project Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 0ebe6382afe24ef489261081e8610271 Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-TestVolumeBootPattern-415641267-project Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance ebdcabcd-b09e-4215-9fd3-914201278c7d could not be found. Jun 21 17:00:17.195592 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': 'ebdcabcd-b09e-4215-9fd3-914201278c7d'} Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebdcabcd-b09e-4215-9fd3-914201278c7d could not be found. Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:17.196590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebdcabcd-b09e-4215-9fd3-914201278c7d could not be found. Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebdcabcd-b09e-4215-9fd3-914201278c7d could not be found. Jun 21 17:00:17.198430 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:17.201609 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Returning 404 to user: Instance ebdcabcd-b09e-4215-9fd3-914201278c7d could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:17.203553 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6de364d1-a782-4294-8627-68c97085e6b5 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d" status: 404 len: 111 microversion: 2.1 time: 0.060116 Jun 21 17:00:17.204661 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 537/1052] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:17 2022] GET /compute/v2.1/servers/ebdcabcd-b09e-4215-9fd3-914201278c7d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:18.003736 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:18.004336 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:18.016295 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:18.025838 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:18.027112 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:18.027579 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:18.048761 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] HTTP exception thrown: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Request method failure captured: Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: DELETE /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 HTTP/1.1 Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfc6mLtJWhgynj42LzZ-zWY63rQIWwprMnpkRdQI4LsmxukSe55XHPfLk8nJMo1S4O10_tuQsmwIFd6xIuAWjy4RKkNV7hHolZVFwtnVF4VVieX0JM9DlTTyFk5Z3rQ4rgCMJ48OkhhWCJjeUl-ttjC2uv5L9Nm9Bk3-LS5oSa9ZpPU Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 17:00:18.051269 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7a8a0ae0c16a41c8b34547406830813a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-TestVolumeBootPattern-415641267-project Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 0ebe6382afe24ef489261081e8610271 Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-TestVolumeBootPattern-415641267-project Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.052812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': 'cff16739-f953-4e6d-9c9c-c283d8ed7c33'} Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:18.053792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.055407 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.060834 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Returning 404 to user: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:18.062065 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d20c5aaa-ba15-41b3-85d2-59fd490e0909 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 404 len: 111 microversion: 2.1 time: 0.066494 Jun 21 17:00:18.062642 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 516/1053] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 17:00:17 2022] DELETE /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:18.071135 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:18.072419 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] [instance: cff16739-f953-4e6d-9c9c-c283d8ed7c33] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:18.080320 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:18.080789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:18.081673 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:18.082295 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:18.103476 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] HTTP exception thrown: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Request method failure captured: Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 HTTP/1.1 Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfc6mLtJWhgynj42LzZ-zWY63rQIWwprMnpkRdQI4LsmxukSe55XHPfLk8nJMo1S4O10_tuQsmwIFd6xIuAWjy4RKkNV7hHolZVFwtnVF4VVieX0JM9DlTTyFk5Z3rQ4rgCMJ48OkhhWCJjeUl-ttjC2uv5L9Nm9Bk3-LS5oSa9ZpPU Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 17:00:18.105861 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a8a0ae0c16a41c8b34547406830813a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7a8a0ae0c16a41c8b34547406830813a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 7a8a0ae0c16a41c8b34547406830813a Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-TestVolumeBootPattern-415641267 Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-TestVolumeBootPattern-415641267-project Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 0ebe6382afe24ef489261081e8610271 Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-TestVolumeBootPattern-415641267-project Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.114307 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': 'cff16739-f953-4e6d-9c9c-c283d8ed7c33'} Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:18.123851 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. Jun 21 17:00:18.126484 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:18.128871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Returning 404 to user: Instance cff16739-f953-4e6d-9c9c-c283d8ed7c33 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:18.128871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1183aa31-4a67-4e0d-bf23-a9d8fe01c3e8 tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33" status: 404 len: 111 microversion: 2.1 time: 0.040291 Jun 21 17:00:18.128871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 538/1054] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:18 2022] GET /compute/v2.1/servers/cff16739-f953-4e6d-9c9c-c283d8ed7c33 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:19.702363 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2a323cea-2059-48b6-8a2c-160c456eb96b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] Calling method '.version_select at 0x7f0a42a1fdc0>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:19.821656 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2a323cea-2059-48b6-8a2c-160c456eb96b tempest-TestVolumeBootPattern-415641267 tempest-TestVolumeBootPattern-415641267-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1039709549" status: 202 len: 0 microversion: 2.1 time: 0.127119 Jun 21 17:00:19.822889 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 517/1055] 10.222.0.70 () {58 vars in 1262 bytes} [Tue Jun 21 17:00:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1039709549 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 17:00:20.380366 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f4bc1230-c7ff-446a-b564-b80e05b53db9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:20.381005 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f4bc1230-c7ff-446a-b564-b80e05b53db9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:20.388034 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f4bc1230-c7ff-446a-b564-b80e05b53db9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:20.388511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f4bc1230-c7ff-446a-b564-b80e05b53db9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:20.389560 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f4bc1230-c7ff-446a-b564-b80e05b53db9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:20.390007 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f4bc1230-c7ff-446a-b564-b80e05b53db9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:20.490620 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-f4bc1230-c7ff-446a-b564-b80e05b53db9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lazy-loading 'services' on Instance uuid 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 17:00:20.751597 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f4bc1230-c7ff-446a-b564-b80e05b53db9 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-volume_attachments/29d6905c-cefc-4662-aafe-23353119f527" status: 202 len: 0 microversion: 2.1 time: 0.374964 Jun 21 17:00:20.752204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 539/1056] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 17:00:20 2022] DELETE /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-volume_attachments/29d6905c-cefc-4662-aafe-23353119f527 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 17:00:20.767555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-0b978ddb-6cc5-4ab1-850d-6867788dc2e0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:20.769248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-0b978ddb-6cc5-4ab1-850d-6867788dc2e0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:20.779179 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b978ddb-6cc5-4ab1-850d-6867788dc2e0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:20.780035 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b978ddb-6cc5-4ab1-850d-6867788dc2e0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:20.781700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b978ddb-6cc5-4ab1-850d-6867788dc2e0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:20.786301 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-0b978ddb-6cc5-4ab1-850d-6867788dc2e0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:20.844967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-0b978ddb-6cc5-4ab1-850d-6867788dc2e0 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084432 Jun 21 17:00:20.845600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 518/1057] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 17:00:20 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:21.862224 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4113e55c-1ad9-4a8c-93df-505b973d8070 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:21.865990 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4113e55c-1ad9-4a8c-93df-505b973d8070 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:21.880891 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4113e55c-1ad9-4a8c-93df-505b973d8070 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:21.885112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4113e55c-1ad9-4a8c-93df-505b973d8070 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:21.885112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4113e55c-1ad9-4a8c-93df-505b973d8070 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:21.885112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-4113e55c-1ad9-4a8c-93df-505b973d8070 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:21.920086 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4113e55c-1ad9-4a8c-93df-505b973d8070 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067398 Jun 21 17:00:21.920752 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 540/1058] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 17:00:21 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 17:00:21.987762 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bcea76cf-136d-45f6-98f4-071691134657 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:21.988426 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bcea76cf-136d-45f6-98f4-071691134657 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:21.996123 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bcea76cf-136d-45f6-98f4-071691134657 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:21.996670 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bcea76cf-136d-45f6-98f4-071691134657 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:21.997610 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bcea76cf-136d-45f6-98f4-071691134657 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:21.998107 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-bcea76cf-136d-45f6-98f4-071691134657 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:22.026790 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-bcea76cf-136d-45f6-98f4-071691134657 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 17:00:22.641791 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bcea76cf-136d-45f6-98f4-071691134657 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 204 len: 0 microversion: 2.1 time: 0.654239 Jun 21 17:00:22.642685 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 519/1059] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 17:00:21 2022] DELETE /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 17:00:22.651101 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e0954823-9c74-46ca-a04f-68e68ad4251d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:22.652738 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e0954823-9c74-46ca-a04f-68e68ad4251d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:22.661649 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e0954823-9c74-46ca-a04f-68e68ad4251d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:22.662464 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e0954823-9c74-46ca-a04f-68e68ad4251d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:22.663496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e0954823-9c74-46ca-a04f-68e68ad4251d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:22.664152 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e0954823-9c74-46ca-a04f-68e68ad4251d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:22.865791 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e0954823-9c74-46ca-a04f-68e68ad4251d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:22.867604 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e0954823-9c74-46ca-a04f-68e68ad4251d tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1681 microversion: 2.1 time: 0.220293 Jun 21 17:00:22.868208 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 541/1060] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:22 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:23.284059 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-41be2a12-38e9-410b-a69e-e7dcccf45032 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Action: 'create', calling method: .version_select at 0x7f0a42a41af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1676541516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB2kaKsTbm2yDeyztwnMm9Yo4lF8P+8J24XYsTplnX0xaQtMUnX8mGZPjTbrHF3tL1wIA+hhXVz5EgTEx3/W98+6wSj5xwdWjGv+AQdo8Mng17FMhP+cIZAW7P8LMgV+A=="}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:23.298928 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-41be2a12-38e9-410b-a69e-e7dcccf45032 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Getting quotas for project 30d08b848eb54ba9855407bcdef52d14. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 17:00:23.303053 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.quota [None req-41be2a12-38e9-410b-a69e-e7dcccf45032 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Getting quotas for user 6e403ec2e4684b8eb884e9aefae351d3 and project 30d08b848eb54ba9855407bcdef52d14. Resources: {'key_pairs'} {{(pid=124686) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 17:00:23.398894 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-41be2a12-38e9-410b-a69e-e7dcccf45032 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.119096 Jun 21 17:00:23.399508 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 520/1061] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jun 21 17:00:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:23.451506 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2123158522", "imageRef": "ffbfd2dd-63b7-43ca-9f0e-59f299fc2cf0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1676541516", "networks": [{"uuid": "adb07e25-8c55-4679-a0bd-97c862695c8d"}]}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:23.510090 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.network.neutron [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] validate_networks() for [('adb07e25-8c55-4679-a0bd-97c862695c8d', None, None, None, None, None)] {{(pid=124685) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 17:00:23.894843 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-44c6b380-694c-444c-865d-f5a1390f8581 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:23.896922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-44c6b380-694c-444c-865d-f5a1390f8581 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:23.907238 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-44c6b380-694c-444c-865d-f5a1390f8581 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:23.907795 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-44c6b380-694c-444c-865d-f5a1390f8581 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:23.908850 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-44c6b380-694c-444c-865d-f5a1390f8581 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:23.910008 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-44c6b380-694c-444c-865d-f5a1390f8581 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:24.039481 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Flavor limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 17:00:24.040524 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Image limits 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 17:00:24.041515 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Flavor pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 17:00:24.041768 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Image pref 0:0:0 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 17:00:24.042117 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.virt.hardware [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124685) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 17:00:24.054804 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:24.057118 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:24.058204 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:24.058694 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:24.078763 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Getting quotas for project 30d08b848eb54ba9855407bcdef52d14. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 17:00:24.084112 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.quota [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Getting quotas for user 6e403ec2e4684b8eb884e9aefae351d3 and project 30d08b848eb54ba9855407bcdef52d14. Resources: {'cores', 'instances', 'ram'} {{(pid=124685) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 17:00:24.098835 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Going to run 1 instances... {{(pid=124685) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 17:00:24.101074 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ffbfd2dd-63b7-43ca-9f0e-59f299fc2cf0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124685) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 17:00:24.341979 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-7304937d-fa2c-4b7a-b407-0ce35f40c767 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891587 Jun 21 17:00:24.342678 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 542/1062] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jun 21 17:00:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 17:00:24.353598 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4f4c8adb-f023-445a-9547-9ca2ddb3ee78 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:24.354212 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-4f4c8adb-f023-445a-9547-9ca2ddb3ee78 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:24.436738 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-4f4c8adb-f023-445a-9547-9ca2ddb3ee78 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:24.447183 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4f4c8adb-f023-445a-9547-9ca2ddb3ee78 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1259 microversion: 2.1 time: 0.097438 Jun 21 17:00:24.447818 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 543/1063] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:24 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1259 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:24.460742 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-44c6b380-694c-444c-865d-f5a1390f8581 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:24.475727 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-44c6b380-694c-444c-865d-f5a1390f8581 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1681 microversion: 2.1 time: 0.594059 Jun 21 17:00:24.476482 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 521/1064] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:23 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1681 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 17:00:25.465727 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-656f4e72-9b48-4823-b32c-74e05169eb6a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:25.466900 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-656f4e72-9b48-4823-b32c-74e05169eb6a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:25.493928 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-d7f574db-2224-44a2-a3fa-a881bb13db79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:25.494597 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-d7f574db-2224-44a2-a3fa-a881bb13db79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:25.507836 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d7f574db-2224-44a2-a3fa-a881bb13db79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:25.508291 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d7f574db-2224-44a2-a3fa-a881bb13db79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:25.509129 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d7f574db-2224-44a2-a3fa-a881bb13db79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:25.514402 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-d7f574db-2224-44a2-a3fa-a881bb13db79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:25.580400 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-656f4e72-9b48-4823-b32c-74e05169eb6a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:25.588007 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-656f4e72-9b48-4823-b32c-74e05169eb6a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1259 microversion: 2.1 time: 0.126934 Jun 21 17:00:25.589182 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 544/1065] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:25 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1259 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:25.598308 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-66785214-12c4-4b18-9b24-562b8ace2e14 req-a647878f-df64-4ac9-a477-d19c1c79672f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d", "name": "network-vif-deleted", "tag": "e2c15a0f-254c-46c0-86c6-6a66c028007e"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:25.623009 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-66785214-12c4-4b18-9b24-562b8ace2e14 req-a647878f-df64-4ac9-a477-d19c1c79672f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:25.623789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-66785214-12c4-4b18-9b24-562b8ace2e14 req-a647878f-df64-4ac9-a477-d19c1c79672f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:25.633571 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-d7f574db-2224-44a2-a3fa-a881bb13db79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c7f32f0624210ae0ba52c022fea5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cafcd59ef1433ba71a47a01b3a331c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:25.645441 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-d7f574db-2224-44a2-a3fa-a881bb13db79 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 200 len: 1614 microversion: 2.1 time: 0.155255 Jun 21 17:00:25.646333 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 522/1066] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:25 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 1614 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:25.652400 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-66785214-12c4-4b18-9b24-562b8ace2e14 req-a647878f-df64-4ac9-a477-d19c1c79672f service nova] Creating event network-vif-deleted:e2c15a0f-254c-46c0-86c6-6a66c028007e for instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d on hv-cinder-79987 Jun 21 17:00:25.659629 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-66785214-12c4-4b18-9b24-562b8ace2e14 req-a647878f-df64-4ac9-a477-d19c1c79672f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068764 Jun 21 17:00:25.660798 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 545/1067] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:26.606493 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2f380c11-252e-44bc-a89e-ab80370b1af5 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:26.607220 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2f380c11-252e-44bc-a89e-ab80370b1af5 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:26.614926 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f380c11-252e-44bc-a89e-ab80370b1af5 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:26.615698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f380c11-252e-44bc-a89e-ab80370b1af5 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:26.616742 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f380c11-252e-44bc-a89e-ab80370b1af5 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:26.617417 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f380c11-252e-44bc-a89e-ab80370b1af5 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:26.642166 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:26.666359 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:26.670679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:26.676107 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:26.676558 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:26.677376 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:26.677824 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:26.693550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d HTTP/1.1 Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 17:00:26.695499 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:26.697265 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d'} Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:26.698279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:26.699721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:26.701180 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:26.701180 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b356b6ca-d2b3-4e51-993a-fc03a537b5b2 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 404 len: 111 microversion: 2.1 time: 0.038825 Jun 21 17:00:26.701180 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 546/1068] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:26 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 17:00:26.706501 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2f380c11-252e-44bc-a89e-ab80370b1af5 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:26.708901 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-53ba7c36-c1b2-4613-a99b-8ecae2f732d6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '.version_select at 0x7f0a433d95e0>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:26.716967 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2f380c11-252e-44bc-a89e-ab80370b1af5 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1311 microversion: 2.1 time: 0.115623 Jun 21 17:00:26.726605 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 523/1069] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:26 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:26.832185 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-53ba7c36-c1b2-4613-a99b-8ecae2f732d6 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003255248" status: 202 len: 0 microversion: 2.1 time: 0.127230 Jun 21 17:00:26.832767 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 547/1070] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jun 21 17:00:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1003255248 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 17:00:27.208367 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 17:00:27.209686 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Tue Jun 21 17:00:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 17:00:27.734826 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8a0784a9-1cf7-42f2-a40d-512453359736 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:27.736133 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8a0784a9-1cf7-42f2-a40d-512453359736 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:27.743737 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8a0784a9-1cf7-42f2-a40d-512453359736 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:27.748305 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8a0784a9-1cf7-42f2-a40d-512453359736 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:27.749808 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8a0784a9-1cf7-42f2-a40d-512453359736 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:27.750272 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8a0784a9-1cf7-42f2-a40d-512453359736 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:27.896252 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-8a0784a9-1cf7-42f2-a40d-512453359736 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:27.907730 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8a0784a9-1cf7-42f2-a40d-512453359736 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1317 microversion: 2.1 time: 0.177354 Jun 21 17:00:27.920133 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 524/1071] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:27 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:28.927883 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8b35a03a-c57a-4e61-a49b-d32f85a537f3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:28.928626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8b35a03a-c57a-4e61-a49b-d32f85a537f3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:28.947686 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8b35a03a-c57a-4e61-a49b-d32f85a537f3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:28.948413 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8b35a03a-c57a-4e61-a49b-d32f85a537f3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:28.951656 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8b35a03a-c57a-4e61-a49b-d32f85a537f3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:28.953981 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8b35a03a-c57a-4e61-a49b-d32f85a537f3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:29.144806 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8b35a03a-c57a-4e61-a49b-d32f85a537f3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:29.178997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8b35a03a-c57a-4e61-a49b-d32f85a537f3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.255332 Jun 21 17:00:29.189149 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 548/1072] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:28 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:29.204427 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:29.209439 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:29.231465 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:29.233349 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:29.234397 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:29.235025 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:29.263265 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: DELETE /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d HTTP/1.1 Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 17:00:29.265463 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.267172 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d'} Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:29.268180 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.270707 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.275199 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:29.277226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-72bebf1f-99c5-4860-9ffa-8f86be42b478 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 404 len: 111 microversion: 2.1 time: 0.078471 Jun 21 17:00:29.287069 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:29.288174 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:29.296950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 525/1073] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 17:00:29 2022] DELETE /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:29.297134 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:29.297134 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:29.298266 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:29.298948 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:29.316714 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d HTTP/1.1 Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 17:00:29.318897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.324354 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d'} Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:29.325472 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. Jun 21 17:00:29.326869 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:29.328644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:29.328644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b44c2ce5-96ae-41b7-975d-f914b2f70925 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d" status: 404 len: 111 microversion: 2.1 time: 0.038837 Jun 21 17:00:29.328644 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 549/1074] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:29 2022] GET /compute/v2.1/servers/0eb6a9d5-7e77-4386-a03d-8a4a666f3b7d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:30.201202 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a3f7410d-ba9d-4771-88f0-8b5e86060564 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:30.202154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a3f7410d-ba9d-4771-88f0-8b5e86060564 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:30.216555 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a3f7410d-ba9d-4771-88f0-8b5e86060564 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:30.217116 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a3f7410d-ba9d-4771-88f0-8b5e86060564 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:30.218525 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a3f7410d-ba9d-4771-88f0-8b5e86060564 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:30.219214 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a3f7410d-ba9d-4771-88f0-8b5e86060564 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:30.540893 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a3f7410d-ba9d-4771-88f0-8b5e86060564 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:30.556883 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a3f7410d-ba9d-4771-88f0-8b5e86060564 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.362137 Jun 21 17:00:30.557687 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 526/1075] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:30 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:30.842699 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:30.843279 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:30.861633 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:30.862334 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:30.863313 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:30.863910 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:30.884494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: DELETE /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 HTTP/1.1 Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 17:00:30.887496 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.889201 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '227de214-598c-4afa-ad15-9ddb51d56ca9'} Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:30.890253 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.892184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.894055 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:30.894055 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-02974086-f50a-4a16-a94d-513e8e7883b4 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 404 len: 111 microversion: 2.1 time: 0.050353 Jun 21 17:00:30.894055 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 550/1076] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 17:00:30 2022] DELETE /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:30.897255 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:30.897940 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 227de214-598c-4afa-ad15-9ddb51d56ca9] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:30.921270 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:30.921270 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:30.921270 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:30.922028 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:30.950707 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-af2151f0-0a63-46eb-bfb9-03277e475a32 req-9a7ecb76-a6d6-49a2-a504-c86a2db15f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8", "tag": "7ced569e-13dc-40fe-83f4-902201abc4f5"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:30.961212 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 HTTP/1.1 Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 17:00:30.971870 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.973832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '227de214-598c-4afa-ad15-9ddb51d56ca9'} Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:30.983862 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. Jun 21 17:00:30.985769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:30.987392 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 227de214-598c-4afa-ad15-9ddb51d56ca9 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:30.987392 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-15a8a073-aa7b-4b7d-8fef-402b20057308 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9" status: 404 len: 111 microversion: 2.1 time: 0.080365 Jun 21 17:00:30.987637 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-af2151f0-0a63-46eb-bfb9-03277e475a32 req-9a7ecb76-a6d6-49a2-a504-c86a2db15f82 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:30.987637 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-af2151f0-0a63-46eb-bfb9-03277e475a32 req-9a7ecb76-a6d6-49a2-a504-c86a2db15f82 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:30.987832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 527/1077] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:30 2022] GET /compute/v2.1/servers/227de214-598c-4afa-ad15-9ddb51d56ca9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:31.001228 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:31.001960 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:31.021631 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:31.023810 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:31.024604 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-af2151f0-0a63-46eb-bfb9-03277e475a32 req-9a7ecb76-a6d6-49a2-a504-c86a2db15f82 service nova] Creating event network-changed:7ced569e-13dc-40fe-83f4-902201abc4f5 for instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 on hv-cinder-79987 Jun 21 17:00:31.027040 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:31.030374 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:31.061470 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-af2151f0-0a63-46eb-bfb9-03277e475a32 req-9a7ecb76-a6d6-49a2-a504-c86a2db15f82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115270 Jun 21 17:00:31.063236 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 551/1078] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:31.071709 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: DELETE /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c HTTP/1.1 Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 17:00:31.073401 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.074915 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '5e0967ec-4512-4953-8d0c-cd5c2616341c'} Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:31.075719 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.077051 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.080897 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:31.082028 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8b2e6475-221e-4436-b909-8a4756cb6710 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 404 len: 111 microversion: 2.1 time: 0.089442 Jun 21 17:00:31.083151 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 528/1079] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 17:00:30 2022] DELETE /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:31.102035 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:31.102850 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 5e0967ec-4512-4953-8d0c-cd5c2616341c] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:31.117022 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:31.117506 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:31.119898 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:31.120572 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c HTTP/1.1 Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 17:00:31.159511 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.161514 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '5e0967ec-4512-4953-8d0c-cd5c2616341c'} Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:31.163190 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. Jun 21 17:00:31.165157 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:31.169393 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 5e0967ec-4512-4953-8d0c-cd5c2616341c could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:31.169393 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f2173788-78e6-4bc2-a3f0-3eb31f8d299f tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c" status: 404 len: 111 microversion: 2.1 time: 0.061776 Jun 21 17:00:31.169393 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 552/1080] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:31 2022] GET /compute/v2.1/servers/5e0967ec-4512-4953-8d0c-cd5c2616341c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:31.576950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-f70cafbd-4f85-4cf0-9c94-c6cdddcc5636 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:31.576950 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-f70cafbd-4f85-4cf0-9c94-c6cdddcc5636 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:31.592335 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f70cafbd-4f85-4cf0-9c94-c6cdddcc5636 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:31.593243 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f70cafbd-4f85-4cf0-9c94-c6cdddcc5636 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:31.594447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f70cafbd-4f85-4cf0-9c94-c6cdddcc5636 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:31.595100 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-f70cafbd-4f85-4cf0-9c94-c6cdddcc5636 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:31.767441 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-f70cafbd-4f85-4cf0-9c94-c6cdddcc5636 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:31.777929 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-f70cafbd-4f85-4cf0-9c94-c6cdddcc5636 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.207145 Jun 21 17:00:31.779117 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 529/1081] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:31 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:32.607788 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:32.608361 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:32.634167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:32.634627 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:32.636167 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:32.636668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:32.651994 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: DELETE /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 HTTP/1.1 Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 17:00:32.653599 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.654997 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'id': '1c19e657-0d31-410a-b755-4e2d41c926d6'} Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:32.655908 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.657404 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.658852 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:32.658852 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-3757d739-59ee-420f-b1af-36653f6660e5 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 404 len: 111 microversion: 2.1 time: 0.051224 Jun 21 17:00:32.658852 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 553/1082] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 17:00:32 2022] DELETE /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:32.668369 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:32.668369 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] [instance: 1c19e657-0d31-410a-b755-4e2d41c926d6] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:32.677749 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:32.678896 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:32.680446 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:32.681458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:32.719955 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] HTTP exception thrown: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Request method failure captured: Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 HTTP/1.1 Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisffPSmP8O9tBOoXeemag0IQuG4c90OwMpI-lyGfp7LJtvPZaz47ScvX5nzLi-sne6zIytF_WepvzjdsY8nDHP6F9EWzP0Buez7Dg-ocNF2VmI0901_DiAtXlCcoLscKdE2ZwY-qPqnDJZ0AebDKkPI2hN5Ut4B2n9up9yuitleT-Q9c Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 17:00:32.723195 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/97cafcd59ef1433ba71a47a01b3a331c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_97cafcd59ef1433ba71a47a01b3a331c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 97cafcd59ef1433ba71a47a01b3a331c Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-81765917 Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 8d1c7f32f0624210ae0ba52c022fea5a Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-AttachVolumeNegativeTest-81765917-project Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.726226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': '1c19e657-0d31-410a-b755-4e2d41c926d6'} Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:00:32.731447 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. Jun 21 17:00:32.735198 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:00:32.737627 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] Returning 404 to user: Instance 1c19e657-0d31-410a-b755-4e2d41c926d6 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:00:32.737627 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-361cf0db-f74a-46af-bab8-3f38353f2c45 tempest-AttachVolumeNegativeTest-81765917 tempest-AttachVolumeNegativeTest-81765917-project] 10.222.0.70 "GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6" status: 404 len: 111 microversion: 2.1 time: 0.067969 Jun 21 17:00:32.737627 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 530/1083] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:32 2022] GET /compute/v2.1/servers/1c19e657-0d31-410a-b755-4e2d41c926d6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:00:32.795136 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-acba5d21-e078-4d48-aced-ccb1838fb47a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:32.795742 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-acba5d21-e078-4d48-aced-ccb1838fb47a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:32.810789 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acba5d21-e078-4d48-aced-ccb1838fb47a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:32.811250 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acba5d21-e078-4d48-aced-ccb1838fb47a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:32.812103 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acba5d21-e078-4d48-aced-ccb1838fb47a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:32.812550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-acba5d21-e078-4d48-aced-ccb1838fb47a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:32.817090 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:33.068450 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-acba5d21-e078-4d48-aced-ccb1838fb47a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:33.078080 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-acba5d21-e078-4d48-aced-ccb1838fb47a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.287069 Jun 21 17:00:33.090179 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 554/1084] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:32 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:34.096384 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4823f4fa-b792-45db-81a9-fb988ea8faf9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:34.099119 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4823f4fa-b792-45db-81a9-fb988ea8faf9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:34.101097 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell0:SELECT=4 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:34.108444 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4823f4fa-b792-45db-81a9-fb988ea8faf9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:34.110206 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4823f4fa-b792-45db-81a9-fb988ea8faf9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:34.111169 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4823f4fa-b792-45db-81a9-fb988ea8faf9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:34.111766 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4823f4fa-b792-45db-81a9-fb988ea8faf9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:34.340178 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4823f4fa-b792-45db-81a9-fb988ea8faf9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:34.361314 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4823f4fa-b792-45db-81a9-fb988ea8faf9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.269100 Jun 21 17:00:34.365408 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 531/1085] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:34 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:35.381408 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:35.390794 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-fac5980c-84d7-4594-81a4-a5e57fc18dac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:35.391460 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-fac5980c-84d7-4594-81a4-a5e57fc18dac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:35.393638 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:35.399682 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fac5980c-84d7-4594-81a4-a5e57fc18dac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:35.400366 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fac5980c-84d7-4594-81a4-a5e57fc18dac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:35.410087 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fac5980c-84d7-4594-81a4-a5e57fc18dac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:35.411320 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-fac5980c-84d7-4594-81a4-a5e57fc18dac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:35.585304 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=10 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:35.612459 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-fac5980c-84d7-4594-81a4-a5e57fc18dac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:35.624270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-fac5980c-84d7-4594-81a4-a5e57fc18dac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.242034 Jun 21 17:00:35.624270 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 555/1086] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:35 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:36.640018 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-97a2894f-6179-4bef-9bf4-b7ff5ff12abd tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:36.642393 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-97a2894f-6179-4bef-9bf4-b7ff5ff12abd tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:36.666968 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:36.667663 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-97a2894f-6179-4bef-9bf4-b7ff5ff12abd tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:36.669687 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-97a2894f-6179-4bef-9bf4-b7ff5ff12abd tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:36.670510 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-97a2894f-6179-4bef-9bf4-b7ff5ff12abd tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:36.672413 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-97a2894f-6179-4bef-9bf4-b7ff5ff12abd tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:36.903991 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-97a2894f-6179-4bef-9bf4-b7ff5ff12abd tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:36.913127 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-97a2894f-6179-4bef-9bf4-b7ff5ff12abd tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.278053 Jun 21 17:00:36.914043 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 532/1087] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:36 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:37.930950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-d4b02ed3-947f-4ddd-8536-2a51ac620c54 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:37.931520 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-d4b02ed3-947f-4ddd-8536-2a51ac620c54 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:37.939797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d4b02ed3-947f-4ddd-8536-2a51ac620c54 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:37.943166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d4b02ed3-947f-4ddd-8536-2a51ac620c54 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:37.943166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d4b02ed3-947f-4ddd-8536-2a51ac620c54 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:37.943166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-d4b02ed3-947f-4ddd-8536-2a51ac620c54 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:38.077117 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-d4b02ed3-947f-4ddd-8536-2a51ac620c54 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:38.084544 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-d4b02ed3-947f-4ddd-8536-2a51ac620c54 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.157833 Jun 21 17:00:38.085115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 556/1088] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:37 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:39.102875 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a922eb03-a29f-405e-b393-9d11d1bd4bf1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:39.103467 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a922eb03-a29f-405e-b393-9d11d1bd4bf1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:39.111624 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a922eb03-a29f-405e-b393-9d11d1bd4bf1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:39.112084 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a922eb03-a29f-405e-b393-9d11d1bd4bf1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:39.112859 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a922eb03-a29f-405e-b393-9d11d1bd4bf1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:39.113325 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a922eb03-a29f-405e-b393-9d11d1bd4bf1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:39.254880 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a922eb03-a29f-405e-b393-9d11d1bd4bf1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:39.263209 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a922eb03-a29f-405e-b393-9d11d1bd4bf1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.164243 Jun 21 17:00:39.263792 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 533/1089] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:39 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:40.281374 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-6770f0b3-e12e-4979-8aa0-a5a7c45b0fa9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:40.285038 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-6770f0b3-e12e-4979-8aa0-a5a7c45b0fa9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:40.288585 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6770f0b3-e12e-4979-8aa0-a5a7c45b0fa9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:40.289011 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6770f0b3-e12e-4979-8aa0-a5a7c45b0fa9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:40.289935 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6770f0b3-e12e-4979-8aa0-a5a7c45b0fa9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:40.290362 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-6770f0b3-e12e-4979-8aa0-a5a7c45b0fa9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:40.430262 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-6770f0b3-e12e-4979-8aa0-a5a7c45b0fa9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:40.438453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-6770f0b3-e12e-4979-8aa0-a5a7c45b0fa9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.162259 Jun 21 17:00:40.439022 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 557/1090] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:40 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:41.284812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fed1aa56-bbe1-44e2-aa7f-e4ccc64adb19 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a42b86dc0>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:41.336687 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fed1aa56-bbe1-44e2-aa7f-e4ccc64adb19 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/87eefe50-f8ac-4dd1-8772-588f6280d309" status: 200 len: 350 microversion: 2.1 time: 0.056859 Jun 21 17:00:41.337258 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 534/1091] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 17:00:41 2022] GET /compute/v2.1/os-volumes/87eefe50-f8ac-4dd1-8772-588f6280d309 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:41.457068 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f80cdd41-288a-4b86-8065-194ed4ec2af8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:41.457795 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f80cdd41-288a-4b86-8065-194ed4ec2af8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:41.465895 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f80cdd41-288a-4b86-8065-194ed4ec2af8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:41.466353 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f80cdd41-288a-4b86-8065-194ed4ec2af8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:41.467308 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f80cdd41-288a-4b86-8065-194ed4ec2af8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:41.467889 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f80cdd41-288a-4b86-8065-194ed4ec2af8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:41.603132 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f80cdd41-288a-4b86-8065-194ed4ec2af8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:41.611115 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f80cdd41-288a-4b86-8065-194ed4ec2af8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.158781 Jun 21 17:00:41.611678 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 558/1092] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:41 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:42.629525 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-fdc631c9-3eaa-43ac-bab7-5eb92de06ae1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:42.630150 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-fdc631c9-3eaa-43ac-bab7-5eb92de06ae1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:42.637905 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fdc631c9-3eaa-43ac-bab7-5eb92de06ae1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:42.638449 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fdc631c9-3eaa-43ac-bab7-5eb92de06ae1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:42.639244 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fdc631c9-3eaa-43ac-bab7-5eb92de06ae1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:42.639917 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-fdc631c9-3eaa-43ac-bab7-5eb92de06ae1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:42.773698 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-fdc631c9-3eaa-43ac-bab7-5eb92de06ae1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:42.783031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-fdc631c9-3eaa-43ac-bab7-5eb92de06ae1 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.159296 Jun 21 17:00:42.784343 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 535/1093] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:42 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:43.558521 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-4cf0d48b-be67-493d-89e0-0c219f9cf963 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a433f4dc0>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:43.608069 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-4cf0d48b-be67-493d-89e0-0c219f9cf963 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/a5981c8f-1dc2-4e7d-84b9-906c86cc4683" status: 200 len: 350 microversion: 2.1 time: 0.054045 Jun 21 17:00:43.608641 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 559/1094] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 17:00:43 2022] GET /compute/v2.1/os-volumes/a5981c8f-1dc2-4e7d-84b9-906c86cc4683 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:43.803468 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-08294477-143a-4b94-bf96-3128d1766e82 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:43.804038 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-08294477-143a-4b94-bf96-3128d1766e82 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:43.810999 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-08294477-143a-4b94-bf96-3128d1766e82 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:43.811459 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-08294477-143a-4b94-bf96-3128d1766e82 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:43.812264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-08294477-143a-4b94-bf96-3128d1766e82 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:43.812699 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-08294477-143a-4b94-bf96-3128d1766e82 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:43.972992 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-08294477-143a-4b94-bf96-3128d1766e82 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:43.981911 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-08294477-143a-4b94-bf96-3128d1766e82 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.182230 Jun 21 17:00:43.982509 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 536/1095] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:43 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:44.190886 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-b2a6da77-981b-4366-a8d6-96e8615654f2 req-3c54f490-b338-43e9-befe-6b3df1927234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8", "name": "network-vif-plugged", "status": "completed", "tag": "7ced569e-13dc-40fe-83f4-902201abc4f5"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:44.203154 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-b2a6da77-981b-4366-a8d6-96e8615654f2 req-3c54f490-b338-43e9-befe-6b3df1927234 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:44.203624 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-b2a6da77-981b-4366-a8d6-96e8615654f2 req-3c54f490-b338-43e9-befe-6b3df1927234 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:44.215725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-b2a6da77-981b-4366-a8d6-96e8615654f2 req-3c54f490-b338-43e9-befe-6b3df1927234 service nova] Creating event network-vif-plugged:7ced569e-13dc-40fe-83f4-902201abc4f5 for instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 on hv-cinder-79987 Jun 21 17:00:44.220933 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-b2a6da77-981b-4366-a8d6-96e8615654f2 req-3c54f490-b338-43e9-befe-6b3df1927234 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159683 Jun 21 17:00:44.222171 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 560/1096] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:44.999305 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-433515bc-bc95-4e9a-b82c-62b9c2cd9aa3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:44.999893 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-433515bc-bc95-4e9a-b82c-62b9c2cd9aa3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:45.006863 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-433515bc-bc95-4e9a-b82c-62b9c2cd9aa3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:45.007567 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-433515bc-bc95-4e9a-b82c-62b9c2cd9aa3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:45.008369 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-433515bc-bc95-4e9a-b82c-62b9c2cd9aa3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:45.008805 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-433515bc-bc95-4e9a-b82c-62b9c2cd9aa3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:45.146844 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-433515bc-bc95-4e9a-b82c-62b9c2cd9aa3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:45.155541 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-433515bc-bc95-4e9a-b82c-62b9c2cd9aa3 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.160794 Jun 21 17:00:45.156062 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 537/1097] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:44 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:45.298984 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1e38bed7-5cdc-44bb-b752-43e85bbbea6a tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a4338a700>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:45.346291 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1e38bed7-5cdc-44bb-b752-43e85bbbea6a tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d6ccbff4-731f-4315-afcf-6415871668aa" status: 200 len: 350 microversion: 2.1 time: 0.052047 Jun 21 17:00:45.346842 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 561/1098] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jun 21 17:00:45 2022] GET /compute/v2.1/os-volumes/d6ccbff4-731f-4315-afcf-6415871668aa => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:45.358975 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-e009da5f-0848-4de7-b707-63c6c0b1468c tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a42b865e0>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:45.444907 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-e009da5f-0848-4de7-b707-63c6c0b1468c tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.090710 Jun 21 17:00:45.445525 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 538/1099] 10.222.0.70 () {58 vars in 1133 bytes} [Tue Jun 21 17:00:45 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:45.458154 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5825641c-a996-46b1-ac5b-1f2f6c27c55c tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a42aab820>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:45.544388 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5825641c-a996-46b1-ac5b-1f2f6c27c55c tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090050 Jun 21 17:00:45.544954 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 562/1100] 10.222.0.70 () {58 vars in 1148 bytes} [Tue Jun 21 17:00:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:45.556535 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ff8328c3-14a2-4d8f-a1c2-ce7550002b26 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a42baad30>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:45.638720 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ff8328c3-14a2-4d8f-a1c2-ce7550002b26 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.085984 Jun 21 17:00:45.639300 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 539/1101] 10.222.0.70 () {58 vars in 1133 bytes} [Tue Jun 21 17:00:45 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:45.650363 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-9706aac5-b92a-4c0d-86bb-e4d03021fa4f tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a43396ca0>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:45.732874 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-9706aac5-b92a-4c0d-86bb-e4d03021fa4f tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086258 Jun 21 17:00:45.733494 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 563/1102] 10.222.0.70 () {58 vars in 1166 bytes} [Tue Jun 21 17:00:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:45.744852 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-b0450b94-2acd-40d5-9fae-f092018fd97c tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a42b4fa60>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:45.832059 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-b0450b94-2acd-40d5-9fae-f092018fd97c tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090852 Jun 21 17:00:45.832624 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 540/1103] 10.222.0.70 () {58 vars in 1169 bytes} [Tue Jun 21 17:00:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:45.845060 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-1ee244c2-13f4-486a-ac56-865a1bc18b44 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a43396550>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:45.929910 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-1ee244c2-13f4-486a-ac56-865a1bc18b44 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088529 Jun 21 17:00:45.930474 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 564/1104] 10.222.0.70 () {58 vars in 1154 bytes} [Tue Jun 21 17:00:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:45.941389 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-bebafc53-0772-4a65-8f10-6de9dbe5cd85 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a42a2f280>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:46.026912 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-bebafc53-0772-4a65-8f10-6de9dbe5cd85 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088197 Jun 21 17:00:46.027587 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 541/1105] 10.222.0.70 () {58 vars in 1187 bytes} [Tue Jun 21 17:00:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:46.038963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e7ccdba8-8429-426a-bd0e-39860f828133 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] Calling method '.version_select at 0x7f0a4372a820>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:46.123522 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e7ccdba8-8429-426a-bd0e-39860f828133 tempest-VolumesTestJSON-1184750060 tempest-VolumesTestJSON-1184750060-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088360 Jun 21 17:00:46.124372 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 565/1106] 10.222.0.70 () {58 vars in 1154 bytes} [Tue Jun 21 17:00:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 17:00:46.172729 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-cb1e67f6-6a28-4d72-b00c-14e783010c4b tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:46.173475 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-cb1e67f6-6a28-4d72-b00c-14e783010c4b tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:46.179586 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cb1e67f6-6a28-4d72-b00c-14e783010c4b tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:46.180031 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cb1e67f6-6a28-4d72-b00c-14e783010c4b tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:46.180788 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cb1e67f6-6a28-4d72-b00c-14e783010c4b tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:46.181220 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-cb1e67f6-6a28-4d72-b00c-14e783010c4b tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:46.316565 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-cb1e67f6-6a28-4d72-b00c-14e783010c4b tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:46.325133 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-cb1e67f6-6a28-4d72-b00c-14e783010c4b tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1359 microversion: 2.1 time: 0.156280 Jun 21 17:00:46.325782 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 542/1107] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:46 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:47.342992 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a389f394-b1aa-4548-b332-b88124bba30c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:47.343716 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a389f394-b1aa-4548-b332-b88124bba30c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:47.350452 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a389f394-b1aa-4548-b332-b88124bba30c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:47.350904 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a389f394-b1aa-4548-b332-b88124bba30c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:47.351717 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a389f394-b1aa-4548-b332-b88124bba30c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:47.352333 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a389f394-b1aa-4548-b332-b88124bba30c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:47.489226 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a389f394-b1aa-4548-b332-b88124bba30c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:47.496975 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a389f394-b1aa-4548-b332-b88124bba30c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1549 microversion: 2.1 time: 0.158928 Jun 21 17:00:47.505649 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 566/1108] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:47 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:47.513549 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2cdf2150-0930-4cc8-89c4-0f201f05373a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:47.514168 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2cdf2150-0930-4cc8-89c4-0f201f05373a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:47.520741 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2cdf2150-0930-4cc8-89c4-0f201f05373a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:47.521130 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2cdf2150-0930-4cc8-89c4-0f201f05373a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:47.521955 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2cdf2150-0930-4cc8-89c4-0f201f05373a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:47.522394 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2cdf2150-0930-4cc8-89c4-0f201f05373a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:47.655633 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2cdf2150-0930-4cc8-89c4-0f201f05373a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:47.664005 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2cdf2150-0930-4cc8-89c4-0f201f05373a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1549 microversion: 2.1 time: 0.153628 Jun 21 17:00:47.664672 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 543/1109] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:47 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:47.681421 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a2bf9e8c-f340-4bea-a4d0-955fa1a49910 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:47.685243 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-a2bf9e8c-f340-4bea-a4d0-955fa1a49910 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:47.686037 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a2bf9e8c-f340-4bea-a4d0-955fa1a49910 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Searching by: {'deleted': False, 'project_id': '30d08b848eb54ba9855407bcdef52d14'} {{(pid=124685) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 17:00:47.692963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2bf9e8c-f340-4bea-a4d0-955fa1a49910 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:47.693453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2bf9e8c-f340-4bea-a4d0-955fa1a49910 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:47.694246 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2bf9e8c-f340-4bea-a4d0-955fa1a49910 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:47.694735 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2bf9e8c-f340-4bea-a4d0-955fa1a49910 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:47.786911 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.multi_cell_list [None req-a2bf9e8c-f340-4bea-a4d0-955fa1a49910 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124685) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 17:00:47.887721 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a2bf9e8c-f340-4bea-a4d0-955fa1a49910 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210165 Jun 21 17:00:47.888325 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 567/1110] 10.222.0.70 () {58 vars in 1124 bytes} [Tue Jun 21 17:00:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:47.898681 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-55b25101-9e50-4936-aa79-455415063164 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:47.899293 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-55b25101-9e50-4936-aa79-455415063164 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:47.906459 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55b25101-9e50-4936-aa79-455415063164 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:47.906909 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55b25101-9e50-4936-aa79-455415063164 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:47.907680 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55b25101-9e50-4936-aa79-455415063164 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:47.908117 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-55b25101-9e50-4936-aa79-455415063164 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:48.045091 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-55b25101-9e50-4936-aa79-455415063164 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:48.053029 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-55b25101-9e50-4936-aa79-455415063164 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1549 microversion: 2.1 time: 0.158329 Jun 21 17:00:48.053656 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 544/1111] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:47 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:00:50.049875 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e23fd557-f35f-44a3-af5e-52090b23d1e6 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0ef4c11-2dfa-4661-8710-4864fccf608e"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:00:50.050993 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e23fd557-f35f-44a3-af5e-52090b23d1e6 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:50.058839 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e23fd557-f35f-44a3-af5e-52090b23d1e6 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:50.059319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e23fd557-f35f-44a3-af5e-52090b23d1e6 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:50.060200 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e23fd557-f35f-44a3-af5e-52090b23d1e6 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:50.060672 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e23fd557-f35f-44a3-af5e-52090b23d1e6 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:51.040701 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e23fd557-f35f-44a3-af5e-52090b23d1e6 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "POST /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994846 Jun 21 17:00:51.041612 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 568/1112] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jun 21 17:00:50 2022] POST /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:00:58.602152 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-dd541870-6919-4f45-a952-0ea6215ae0a0 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:00:58.602769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-dd541870-6919-4f45-a952-0ea6215ae0a0 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:00:58.605960 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=15 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:58.606634 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=84 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:00:58.611385 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dd541870-6919-4f45-a952-0ea6215ae0a0 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:58.611876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dd541870-6919-4f45-a952-0ea6215ae0a0 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:58.612650 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dd541870-6919-4f45-a952-0ea6215ae0a0 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:00:58.613089 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dd541870-6919-4f45-a952-0ea6215ae0a0 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:00:58.768334 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-dd541870-6919-4f45-a952-0ea6215ae0a0 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:00:58.776291 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-dd541870-6919-4f45-a952-0ea6215ae0a0 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1595 microversion: 2.1 time: 0.178039 Jun 21 17:00:58.777613 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 545/1113] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:00:58 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1595 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:01.491679 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell0:SELECT=2 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:01.499975 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=15 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:01.500590 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:01.638406 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-d486cd4e-7f21-410b-a4a0-05a1a388eb20 req-7169d44b-c54b-451e-9abb-b32c933cfaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8", "tag": "7ced569e-13dc-40fe-83f4-902201abc4f5"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:01:01.652774 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-d486cd4e-7f21-410b-a4a0-05a1a388eb20 req-7169d44b-c54b-451e-9abb-b32c933cfaa1 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:01.653693 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-d486cd4e-7f21-410b-a4a0-05a1a388eb20 req-7169d44b-c54b-451e-9abb-b32c933cfaa1 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:01.670263 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-d486cd4e-7f21-410b-a4a0-05a1a388eb20 req-7169d44b-c54b-451e-9abb-b32c933cfaa1 service nova] Creating event network-changed:7ced569e-13dc-40fe-83f4-902201abc4f5 for instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 on hv-cinder-79987 Jun 21 17:01:01.676550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-d486cd4e-7f21-410b-a4a0-05a1a388eb20 req-7169d44b-c54b-451e-9abb-b32c933cfaa1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187224 Jun 21 17:01:01.677661 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 569/1114] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:01:04.582311 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-c2ddf182-3256-4779-8460-26845decadc8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1517719300"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:01:04.582891 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-c2ddf182-3256-4779-8460-26845decadc8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:04.589067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2ddf182-3256-4779-8460-26845decadc8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:04.589550 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2ddf182-3256-4779-8460-26845decadc8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:04.590322 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2ddf182-3256-4779-8460-26845decadc8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:04.590759 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-c2ddf182-3256-4779-8460-26845decadc8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:04.732053 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.network.security_group_api [None req-c2ddf182-3256-4779-8460-26845decadc8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Adding security group 0c94e399-fbd2-47ba-9d61-1dcce0dc0c1a to port 7ced569e-13dc-40fe-83f4-902201abc4f5 Jun 21 17:01:05.189962 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-c2ddf182-3256-4779-8460-26845decadc8 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "POST /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/action" status: 202 len: 0 microversion: 2.1 time: 0.614979 Jun 21 17:01:05.191152 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 546/1115] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 17:01:04 2022] POST /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 17:01:05.201261 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-519d38c4-27d9-4fce-9f02-bb2f971d170c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:05.202578 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-519d38c4-27d9-4fce-9f02-bb2f971d170c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:05.206283 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-dc0b8c69-17e2-454b-972b-8857d9539806 req-0afd8579-7a14-4a3d-9adf-143b789e46a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8", "tag": "7ced569e-13dc-40fe-83f4-902201abc4f5"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:01:05.209855 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-519d38c4-27d9-4fce-9f02-bb2f971d170c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:05.210507 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-519d38c4-27d9-4fce-9f02-bb2f971d170c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:05.211503 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-519d38c4-27d9-4fce-9f02-bb2f971d170c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:05.212101 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-519d38c4-27d9-4fce-9f02-bb2f971d170c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:05.216739 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-dc0b8c69-17e2-454b-972b-8857d9539806 req-0afd8579-7a14-4a3d-9adf-143b789e46a1 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:05.217656 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-dc0b8c69-17e2-454b-972b-8857d9539806 req-0afd8579-7a14-4a3d-9adf-143b789e46a1 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:05.232125 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-dc0b8c69-17e2-454b-972b-8857d9539806 req-0afd8579-7a14-4a3d-9adf-143b789e46a1 service nova] Creating event network-changed:7ced569e-13dc-40fe-83f4-902201abc4f5 for instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 on hv-cinder-79987 Jun 21 17:01:05.246110 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-dc0b8c69-17e2-454b-972b-8857d9539806 req-0afd8579-7a14-4a3d-9adf-143b789e46a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046236 Jun 21 17:01:05.246897 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 547/1116] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 17:01:05.403662 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-519d38c4-27d9-4fce-9f02-bb2f971d170c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:05.415053 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-519d38c4-27d9-4fce-9f02-bb2f971d170c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1760 microversion: 2.1 time: 0.219664 Jun 21 17:01:05.416622 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 570/1117] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:05 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1760 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:22.530955 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=6 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:22.531693 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=12 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:22.535916 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-3b74a89a-7a46-447b-a68f-660fa7989b14 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:01:22.536985 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-3b74a89a-7a46-447b-a68f-660fa7989b14 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:22.543152 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3b74a89a-7a46-447b-a68f-660fa7989b14 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:22.545619 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3b74a89a-7a46-447b-a68f-660fa7989b14 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:22.545619 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3b74a89a-7a46-447b-a68f-660fa7989b14 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:22.545619 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-3b74a89a-7a46-447b-a68f-660fa7989b14 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:22.816332 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-3b74a89a-7a46-447b-a68f-660fa7989b14 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "POST /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/action" status: 202 len: 0 microversion: 2.1 time: 0.286630 Jun 21 17:01:22.816876 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 548/1118] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 17:01:22 2022] POST /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 17:01:22.831587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-abfa241a-04d0-4530-a909-0fa8ef32bb07 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:22.831587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-abfa241a-04d0-4530-a909-0fa8ef32bb07 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:22.831587 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=4 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:01:22.835250 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-abfa241a-04d0-4530-a909-0fa8ef32bb07 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:22.835777 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-abfa241a-04d0-4530-a909-0fa8ef32bb07 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:22.836583 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-abfa241a-04d0-4530-a909-0fa8ef32bb07 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:22.837019 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-abfa241a-04d0-4530-a909-0fa8ef32bb07 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:22.989797 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-abfa241a-04d0-4530-a909-0fa8ef32bb07 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:22.999360 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-abfa241a-04d0-4530-a909-0fa8ef32bb07 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1752 microversion: 2.1 time: 0.177931 Jun 21 17:01:22.999739 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 571/1119] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:22 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 17:01:24.018272 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-7c50384a-2816-4aa2-9d69-d4f52743c804 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:24.019209 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-7c50384a-2816-4aa2-9d69-d4f52743c804 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:24.026154 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7c50384a-2816-4aa2-9d69-d4f52743c804 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:24.026600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7c50384a-2816-4aa2-9d69-d4f52743c804 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:24.027371 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7c50384a-2816-4aa2-9d69-d4f52743c804 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:24.027840 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-7c50384a-2816-4aa2-9d69-d4f52743c804 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:24.185025 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-7c50384a-2816-4aa2-9d69-d4f52743c804 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:24.193669 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-7c50384a-2816-4aa2-9d69-d4f52743c804 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.180476 Jun 21 17:01:24.194254 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 549/1120] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:24 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:25.212193 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8e35a62d-5e56-4ac8-a69a-4f950f1a1391 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:25.212799 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8e35a62d-5e56-4ac8-a69a-4f950f1a1391 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:25.220185 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e35a62d-5e56-4ac8-a69a-4f950f1a1391 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:25.220636 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e35a62d-5e56-4ac8-a69a-4f950f1a1391 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:25.221453 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e35a62d-5e56-4ac8-a69a-4f950f1a1391 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:25.221893 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8e35a62d-5e56-4ac8-a69a-4f950f1a1391 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:25.370787 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-8e35a62d-5e56-4ac8-a69a-4f950f1a1391 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:25.379128 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8e35a62d-5e56-4ac8-a69a-4f950f1a1391 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.170829 Jun 21 17:01:25.379701 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 572/1121] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:25 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:26.396815 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4f55b6fc-0ec3-434e-95c3-6701cbe9f762 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:26.397458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4f55b6fc-0ec3-434e-95c3-6701cbe9f762 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:26.405213 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4f55b6fc-0ec3-434e-95c3-6701cbe9f762 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:26.405629 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4f55b6fc-0ec3-434e-95c3-6701cbe9f762 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:26.406330 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4f55b6fc-0ec3-434e-95c3-6701cbe9f762 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:26.406765 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4f55b6fc-0ec3-434e-95c3-6701cbe9f762 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:26.552683 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4f55b6fc-0ec3-434e-95c3-6701cbe9f762 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:26.561415 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4f55b6fc-0ec3-434e-95c3-6701cbe9f762 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.168502 Jun 21 17:01:26.562118 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 550/1122] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:26 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:27.580909 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-b89552d9-fe83-428f-aa75-22e2bb168518 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:27.581533 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-b89552d9-fe83-428f-aa75-22e2bb168518 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:27.587962 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b89552d9-fe83-428f-aa75-22e2bb168518 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:27.588406 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b89552d9-fe83-428f-aa75-22e2bb168518 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:27.589169 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b89552d9-fe83-428f-aa75-22e2bb168518 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:27.589648 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-b89552d9-fe83-428f-aa75-22e2bb168518 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:27.749322 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-b89552d9-fe83-428f-aa75-22e2bb168518 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:27.757668 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-b89552d9-fe83-428f-aa75-22e2bb168518 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.182436 Jun 21 17:01:27.758230 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 573/1123] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:27 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:28.774362 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-6e501112-d1bb-4f40-b3e5-a0c798a80995 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:28.774970 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-6e501112-d1bb-4f40-b3e5-a0c798a80995 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:28.781805 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6e501112-d1bb-4f40-b3e5-a0c798a80995 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:28.782248 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6e501112-d1bb-4f40-b3e5-a0c798a80995 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:28.783009 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6e501112-d1bb-4f40-b3e5-a0c798a80995 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:28.783457 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-6e501112-d1bb-4f40-b3e5-a0c798a80995 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:28.938749 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-6e501112-d1bb-4f40-b3e5-a0c798a80995 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:28.946972 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-6e501112-d1bb-4f40-b3e5-a0c798a80995 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.176406 Jun 21 17:01:28.947745 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 551/1124] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:28 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:29.963671 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-52c73cd0-cf23-4d43-98f4-9f2f58065c45 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:29.964272 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-52c73cd0-cf23-4d43-98f4-9f2f58065c45 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:29.971412 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-52c73cd0-cf23-4d43-98f4-9f2f58065c45 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:29.971860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-52c73cd0-cf23-4d43-98f4-9f2f58065c45 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:29.972611 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-52c73cd0-cf23-4d43-98f4-9f2f58065c45 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:29.973044 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-52c73cd0-cf23-4d43-98f4-9f2f58065c45 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:30.116142 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-52c73cd0-cf23-4d43-98f4-9f2f58065c45 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:30.124396 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-52c73cd0-cf23-4d43-98f4-9f2f58065c45 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.164457 Jun 21 17:01:30.124962 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 574/1125] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:29 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:31.143098 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ac8fac72-dfc0-4ab6-9a32-279533eb0510 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:31.143652 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ac8fac72-dfc0-4ab6-9a32-279533eb0510 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:31.150363 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ac8fac72-dfc0-4ab6-9a32-279533eb0510 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:31.150812 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ac8fac72-dfc0-4ab6-9a32-279533eb0510 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:31.151577 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ac8fac72-dfc0-4ab6-9a32-279533eb0510 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:31.152076 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ac8fac72-dfc0-4ab6-9a32-279533eb0510 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:31.299039 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ac8fac72-dfc0-4ab6-9a32-279533eb0510 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:31.307173 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ac8fac72-dfc0-4ab6-9a32-279533eb0510 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.168374 Jun 21 17:01:31.307770 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 552/1126] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:31 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:32.324524 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-724d37c3-ee03-4190-a7fd-fa9e1690754a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:32.325122 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-724d37c3-ee03-4190-a7fd-fa9e1690754a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:32.331892 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-724d37c3-ee03-4190-a7fd-fa9e1690754a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:32.332337 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-724d37c3-ee03-4190-a7fd-fa9e1690754a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:32.333092 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-724d37c3-ee03-4190-a7fd-fa9e1690754a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:32.333546 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-724d37c3-ee03-4190-a7fd-fa9e1690754a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:32.479345 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-724d37c3-ee03-4190-a7fd-fa9e1690754a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:32.488220 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-724d37c3-ee03-4190-a7fd-fa9e1690754a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.167606 Jun 21 17:01:32.488778 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 575/1127] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:32 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:33.505773 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-a97976a9-2981-4ca9-8ae0-8413b530ec2a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:33.506659 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-a97976a9-2981-4ca9-8ae0-8413b530ec2a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:33.515619 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a97976a9-2981-4ca9-8ae0-8413b530ec2a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:33.516226 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a97976a9-2981-4ca9-8ae0-8413b530ec2a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:33.517393 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a97976a9-2981-4ca9-8ae0-8413b530ec2a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:33.518046 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-a97976a9-2981-4ca9-8ae0-8413b530ec2a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:33.677099 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-a97976a9-2981-4ca9-8ae0-8413b530ec2a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:33.685136 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-a97976a9-2981-4ca9-8ae0-8413b530ec2a tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.183837 Jun 21 17:01:33.686323 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 553/1128] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:33 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:34.703963 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-f26a4713-3fcf-4b40-a7b0-a8adbe9e3e9d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:34.704565 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-f26a4713-3fcf-4b40-a7b0-a8adbe9e3e9d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:34.711184 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f26a4713-3fcf-4b40-a7b0-a8adbe9e3e9d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:34.711626 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f26a4713-3fcf-4b40-a7b0-a8adbe9e3e9d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:34.712403 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f26a4713-3fcf-4b40-a7b0-a8adbe9e3e9d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:34.712830 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-f26a4713-3fcf-4b40-a7b0-a8adbe9e3e9d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:34.860065 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-f26a4713-3fcf-4b40-a7b0-a8adbe9e3e9d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:34.868203 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-f26a4713-3fcf-4b40-a7b0-a8adbe9e3e9d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.169227 Jun 21 17:01:34.868705 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 576/1129] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:34 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:35.886013 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-00ac1e4a-60d2-42b6-832c-8a26f2934950 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:35.886652 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-00ac1e4a-60d2-42b6-832c-8a26f2934950 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:35.894067 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-00ac1e4a-60d2-42b6-832c-8a26f2934950 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:35.894510 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-00ac1e4a-60d2-42b6-832c-8a26f2934950 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:35.895267 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-00ac1e4a-60d2-42b6-832c-8a26f2934950 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:35.895700 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-00ac1e4a-60d2-42b6-832c-8a26f2934950 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:36.040201 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-00ac1e4a-60d2-42b6-832c-8a26f2934950 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:36.050400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-00ac1e4a-60d2-42b6-832c-8a26f2934950 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.166396 Jun 21 17:01:36.050400 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 554/1130] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:35 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:37.066714 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-481a2d00-660d-4e37-879a-6c1933bb719e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:37.067319 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-481a2d00-660d-4e37-879a-6c1933bb719e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:37.073755 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-481a2d00-660d-4e37-879a-6c1933bb719e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:37.074195 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-481a2d00-660d-4e37-879a-6c1933bb719e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:37.074964 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-481a2d00-660d-4e37-879a-6c1933bb719e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:37.075400 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-481a2d00-660d-4e37-879a-6c1933bb719e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:37.221531 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-481a2d00-660d-4e37-879a-6c1933bb719e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:37.229600 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-481a2d00-660d-4e37-879a-6c1933bb719e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.167206 Jun 21 17:01:37.230160 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 577/1131] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:37 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:38.248158 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-2f470b52-50c5-499f-ad8a-09f78525b655 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:38.249597 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-2f470b52-50c5-499f-ad8a-09f78525b655 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:38.256600 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f470b52-50c5-499f-ad8a-09f78525b655 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:38.257040 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f470b52-50c5-499f-ad8a-09f78525b655 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:38.258173 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f470b52-50c5-499f-ad8a-09f78525b655 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:38.258638 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-2f470b52-50c5-499f-ad8a-09f78525b655 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:38.407588 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-2f470b52-50c5-499f-ad8a-09f78525b655 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:38.415490 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-2f470b52-50c5-499f-ad8a-09f78525b655 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.171814 Jun 21 17:01:38.416047 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 555/1132] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:38 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:39.432816 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-e50e5a24-dc9e-4ee6-b6c2-57c044b7673d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:39.433758 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-e50e5a24-dc9e-4ee6-b6c2-57c044b7673d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:39.440356 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e50e5a24-dc9e-4ee6-b6c2-57c044b7673d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:39.440807 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e50e5a24-dc9e-4ee6-b6c2-57c044b7673d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:39.441610 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e50e5a24-dc9e-4ee6-b6c2-57c044b7673d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:39.442072 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-e50e5a24-dc9e-4ee6-b6c2-57c044b7673d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:39.589251 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-e50e5a24-dc9e-4ee6-b6c2-57c044b7673d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:39.597878 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-e50e5a24-dc9e-4ee6-b6c2-57c044b7673d tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1757 microversion: 2.1 time: 0.168912 Jun 21 17:01:39.606193 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 578/1133] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:39 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:01:40.615229 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-dc3814a9-2c15-49ea-bec0-5c11400bf4c9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:01:40.615835 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-dc3814a9-2c15-49ea-bec0-5c11400bf4c9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:01:40.622259 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dc3814a9-2c15-49ea-bec0-5c11400bf4c9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:40.622701 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dc3814a9-2c15-49ea-bec0-5c11400bf4c9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:40.623470 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dc3814a9-2c15-49ea-bec0-5c11400bf4c9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:01:40.623887 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dc3814a9-2c15-49ea-bec0-5c11400bf4c9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:01:40.776985 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-dc3814a9-2c15-49ea-bec0-5c11400bf4c9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:01:40.785377 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-dc3814a9-2c15-49ea-bec0-5c11400bf4c9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1760 microversion: 2.1 time: 0.174017 Jun 21 17:01:40.789650 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 556/1134] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:01:40 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:02:13.849126 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-8b7a035c-cfb0-48bf-9460-8b6ac147dc3e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1517719300"}} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:02:13.849811 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-8b7a035c-cfb0-48bf-9460-8b6ac147dc3e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:13.851966 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_api:SELECT=16 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:13.852612 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG dbcounter [-] [124685] Writing DB stats nova_cell1:SELECT=56 {{(pid=124685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:13.857303 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8b7a035c-cfb0-48bf-9460-8b6ac147dc3e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:13.857768 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8b7a035c-cfb0-48bf-9460-8b6ac147dc3e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:13.858522 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8b7a035c-cfb0-48bf-9460-8b6ac147dc3e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:13.858953 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-8b7a035c-cfb0-48bf-9460-8b6ac147dc3e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:13.992113 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.network.security_group_api [None req-8b7a035c-cfb0-48bf-9460-8b6ac147dc3e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Removing security group 0c94e399-fbd2-47ba-9d61-1dcce0dc0c1a from port 7ced569e-13dc-40fe-83f4-902201abc4f5 Jun 21 17:02:14.442047 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-8b7a035c-cfb0-48bf-9460-8b6ac147dc3e tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "POST /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/action" status: 202 len: 0 microversion: 2.1 time: 0.596867 Jun 21 17:02:14.443725 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 579/1135] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jun 21 17:02:13 2022] POST /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 17:02:14.453678 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [req-fd490be6-595e-4513-aba9-bdafb934cc84 req-b6272f2e-88ac-483d-910b-842f7be1de04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8", "tag": "7ced569e-13dc-40fe-83f4-902201abc4f5"}]} {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:02:14.459511 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_api:SELECT=18 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:14.460688 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG dbcounter [-] [124686] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 17:02:14.466528 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-fd490be6-595e-4513-aba9-bdafb934cc84 req-b6272f2e-88ac-483d-910b-842f7be1de04 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:14.469105 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [req-fd490be6-595e-4513-aba9-bdafb934cc84 req-b6272f2e-88ac-483d-910b-842f7be1de04 service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:14.482701 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.compute.server_external_events [req-fd490be6-595e-4513-aba9-bdafb934cc84 req-b6272f2e-88ac-483d-910b-842f7be1de04 service nova] Creating event network-changed:7ced569e-13dc-40fe-83f4-902201abc4f5 for instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 on hv-cinder-79987 Jun 21 17:02:14.498591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [req-fd490be6-595e-4513-aba9-bdafb934cc84 req-b6272f2e-88ac-483d-910b-842f7be1de04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041946 Jun 21 17:02:14.498591 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 557/1136] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:02:16.093768 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-a2f523d8-d2c0-480d-ad68-617f9ed56607 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:16.094491 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-a2f523d8-d2c0-480d-ad68-617f9ed56607 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:16.101256 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2f523d8-d2c0-480d-ad68-617f9ed56607 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:16.101809 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2f523d8-d2c0-480d-ad68-617f9ed56607 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:16.102643 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2f523d8-d2c0-480d-ad68-617f9ed56607 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:16.103155 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-a2f523d8-d2c0-480d-ad68-617f9ed56607 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:16.188871 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-a2f523d8-d2c0-480d-ad68-617f9ed56607 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lazy-loading 'services' on Instance uuid b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 17:02:16.451463 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-a2f523d8-d2c0-480d-ad68-617f9ed56607 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments/e0ef4c11-2dfa-4661-8710-4864fccf608e" status: 202 len: 0 microversion: 2.1 time: 0.362253 Jun 21 17:02:16.451979 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 580/1137] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 17:02:16 2022] DELETE /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments/e0ef4c11-2dfa-4661-8710-4864fccf608e => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 17:02:16.463432 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-dcc12972-a2a1-4398-b336-e2be5a1f85ac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:16.464437 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-dcc12972-a2a1-4398-b336-e2be5a1f85ac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:16.471465 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dcc12972-a2a1-4398-b336-e2be5a1f85ac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:16.472045 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dcc12972-a2a1-4398-b336-e2be5a1f85ac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:16.473458 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dcc12972-a2a1-4398-b336-e2be5a1f85ac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:16.473886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-dcc12972-a2a1-4398-b336-e2be5a1f85ac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:16.505123 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-dcc12972-a2a1-4398-b336-e2be5a1f85ac tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046767 Jun 21 17:02:16.506032 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 558/1138] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 17:02:16 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:02:16.508860 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-371aad2b-8cf1-49ad-b1e4-2a923f522b5a req-a870324a-d1d4-43bb-b93c-3e6ff7e60d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8", "tag": "7ced569e-13dc-40fe-83f4-902201abc4f5"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:02:16.517089 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-371aad2b-8cf1-49ad-b1e4-2a923f522b5a req-a870324a-d1d4-43bb-b93c-3e6ff7e60d8f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:16.517550 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-371aad2b-8cf1-49ad-b1e4-2a923f522b5a req-a870324a-d1d4-43bb-b93c-3e6ff7e60d8f service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:16.529897 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-371aad2b-8cf1-49ad-b1e4-2a923f522b5a req-a870324a-d1d4-43bb-b93c-3e6ff7e60d8f service nova] Creating event network-changed:7ced569e-13dc-40fe-83f4-902201abc4f5 for instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 on hv-cinder-79987 Jun 21 17:02:16.535314 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-371aad2b-8cf1-49ad-b1e4-2a923f522b5a req-a870324a-d1d4-43bb-b93c-3e6ff7e60d8f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031511 Jun 21 17:02:16.537447 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 581/1139] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 17:02:17.517734 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-8e145faa-963b-4e37-a589-9b50be4b3dee tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:17.518832 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-8e145faa-963b-4e37-a589-9b50be4b3dee tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:17.528931 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e145faa-963b-4e37-a589-9b50be4b3dee tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:17.528931 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e145faa-963b-4e37-a589-9b50be4b3dee tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:17.528931 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e145faa-963b-4e37-a589-9b50be4b3dee tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:17.528931 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-8e145faa-963b-4e37-a589-9b50be4b3dee tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:17.558123 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-8e145faa-963b-4e37-a589-9b50be4b3dee tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044338 Jun 21 17:02:17.558886 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 559/1140] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jun 21 17:02:17 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 17:02:17.570164 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:17.570726 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:17.576905 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:17.580666 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:17.580666 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:17.580666 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:17.655834 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.wsgi [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] HTTP exception thrown: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 is not attached to volume e0ef4c11-2dfa-4661-8710-4864fccf608e Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Request method failure captured: Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: request: DELETE /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments/e0ef4c11-2dfa-4661-8710-4864fccf608e HTTP/1.1 Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept: application/json Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Accept-Encoding: identity Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Connection: close Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Length: 0 Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Content-Type: application/json Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Host: 10.222.0.70 Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Openstack-System-Scope: None Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: User-Agent: python-urllib3/1.26.9 Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Auth-Token: gAAAAABisfkTbM74Vrf_v4m9UahWPt78lsPiUJhJTe6pzWxtDHHFlUeIfN-CJ1xev3U5xVLgzRd7zXLaDZ2AHriWgeihdOtpEkQjGfq2PlRmZzSotF_njQIOR9zB0dju2Wy4pII-M8RwURxgB8xcoEfP5im8_f9Ju8UHFdTN6qLybzpbdOvMDEQ Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Id: None Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Domain-Name: None Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Identity-Status: Confirmed Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Is-Admin-Project: True Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Id: default Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Domain-Name: Default Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Id: 30d08b848eb54ba9855407bcdef52d14 Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Project-Name: tempest-TestMinimumBasicScenario-1550387160 Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Role: reader,member Jun 21 17:02:17.658259 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Roles: reader,member Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/30d08b848eb54ba9855407bcdef52d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/30d08b848eb54ba9855407bcdef52d14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/30d08b848eb54ba9855407bcdef52d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_30d08b848eb54ba9855407bcdef52d14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant: tempest-TestMinimumBasicScenario-1550387160 Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Id: 30d08b848eb54ba9855407bcdef52d14 Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1550387160 Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User: tempest-TestMinimumBasicScenario-1550387160-project Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Id: default Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Domain-Name: Default Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Id: 6e403ec2e4684b8eb884e9aefae351d3 Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: X-User-Name: tempest-TestMinimumBasicScenario-1550387160-project Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: method: > Jun 21 17:02:17.661003 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: exception: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 is not attached to volume e0ef4c11-2dfa-4661-8710-4864fccf608e Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: action_args: {'server_id': 'b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8', 'id': 'e0ef4c11-2dfa-4661-8710-4864fccf608e'} Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e0ef4c11-2dfa-4661-8710-4864fccf608e. Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:02:17.662138 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 is not attached to volume e0ef4c11-2dfa-4661-8710-4864fccf608e Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 is not attached to volume e0ef4c11-2dfa-4661-8710-4864fccf608e Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: ERROR nova.api.openstack.wsgi Jun 21 17:02:17.663894 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Returning 404 to user: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 is not attached to volume e0ef4c11-2dfa-4661-8710-4864fccf608e {{(pid=124685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:02:17.665210 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-5388fa91-822a-4632-87a4-a8201e980c1c tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments/e0ef4c11-2dfa-4661-8710-4864fccf608e" status: 404 len: 154 microversion: 2.1 time: 0.095587 Jun 21 17:02:17.666058 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 582/1141] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jun 21 17:02:17 2022] DELETE /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8/os-volume_attachments/e0ef4c11-2dfa-4661-8710-4864fccf608e => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:02:18.981655 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-1dd58498-e8a2-4bb8-84a8-5b1de2fb3ac7 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:18.982165 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1dd58498-e8a2-4bb8-84a8-5b1de2fb3ac7 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:18.989496 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1dd58498-e8a2-4bb8-84a8-5b1de2fb3ac7 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:18.989940 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1dd58498-e8a2-4bb8-84a8-5b1de2fb3ac7 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:18.990694 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1dd58498-e8a2-4bb8-84a8-5b1de2fb3ac7 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:18.991124 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-1dd58498-e8a2-4bb8-84a8-5b1de2fb3ac7 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:19.016040 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-1dd58498-e8a2-4bb8-84a8-5b1de2fb3ac7 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Going to try to terminate instance {{(pid=124686) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 17:02:19.475127 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-1dd58498-e8a2-4bb8-84a8-5b1de2fb3ac7 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 204 len: 0 microversion: 2.1 time: 0.497361 Jun 21 17:02:19.475726 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 560/1142] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jun 21 17:02:18 2022] DELETE /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 17:02:19.484171 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-658c067b-c4c7-4794-8659-f92036f69169 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:19.484798 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-658c067b-c4c7-4794-8659-f92036f69169 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:19.491579 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658c067b-c4c7-4794-8659-f92036f69169 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:19.492023 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658c067b-c4c7-4794-8659-f92036f69169 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:19.492812 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658c067b-c4c7-4794-8659-f92036f69169 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:19.493246 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-658c067b-c4c7-4794-8659-f92036f69169 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:19.622962 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-658c067b-c4c7-4794-8659-f92036f69169 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:02:19.631398 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-658c067b-c4c7-4794-8659-f92036f69169 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1555 microversion: 2.1 time: 0.151090 Jun 21 17:02:19.632380 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 583/1143] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:02:19 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:02:20.649857 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-ff6a8522-42b8-4b70-b408-4f48ba6b92b9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:20.650559 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-ff6a8522-42b8-4b70-b408-4f48ba6b92b9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:20.657005 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ff6a8522-42b8-4b70-b408-4f48ba6b92b9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:20.657494 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ff6a8522-42b8-4b70-b408-4f48ba6b92b9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:20.658294 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ff6a8522-42b8-4b70-b408-4f48ba6b92b9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:20.658728 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-ff6a8522-42b8-4b70-b408-4f48ba6b92b9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:20.790522 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-ff6a8522-42b8-4b70-b408-4f48ba6b92b9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:02:20.798495 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-ff6a8522-42b8-4b70-b408-4f48ba6b92b9 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1555 microversion: 2.1 time: 0.152852 Jun 21 17:02:20.799055 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 561/1144] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:02:20 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:02:21.763788 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [req-44dc50d2-6bff-4e9f-a907-b6eeb6b15aea req-ec398fb1-1184-4f72-b445-6c247d6ca4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8", "name": "network-vif-deleted", "tag": "7ced569e-13dc-40fe-83f4-902201abc4f5"}]} {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 17:02:21.772620 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-44dc50d2-6bff-4e9f-a907-b6eeb6b15aea req-ec398fb1-1184-4f72-b445-6c247d6ca4df service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:21.773063 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [req-44dc50d2-6bff-4e9f-a907-b6eeb6b15aea req-ec398fb1-1184-4f72-b445-6c247d6ca4df service nova] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:21.784050 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.compute.server_external_events [req-44dc50d2-6bff-4e9f-a907-b6eeb6b15aea req-ec398fb1-1184-4f72-b445-6c247d6ca4df service nova] Creating event network-vif-deleted:7ced569e-13dc-40fe-83f4-902201abc4f5 for instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 on hv-cinder-79987 Jun 21 17:02:21.789684 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [req-44dc50d2-6bff-4e9f-a907-b6eeb6b15aea req-ec398fb1-1184-4f72-b445-6c247d6ca4df service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029773 Jun 21 17:02:21.790458 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 584/1145] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jun 21 17:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 17:02:21.816074 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-4f615d0a-ce31-4de9-b7b7-87c3c637d739 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:21.816722 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-4f615d0a-ce31-4de9-b7b7-87c3c637d739 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:21.823236 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4f615d0a-ce31-4de9-b7b7-87c3c637d739 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:21.823690 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4f615d0a-ce31-4de9-b7b7-87c3c637d739 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:21.824498 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4f615d0a-ce31-4de9-b7b7-87c3c637d739 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:21.824922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-4f615d0a-ce31-4de9-b7b7-87c3c637d739 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:21.887655 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.policy [None req-4f615d0a-ce31-4de9-b7b7-87c3c637d739 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124686) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:02:21.895821 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-4f615d0a-ce31-4de9-b7b7-87c3c637d739 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1513 microversion: 2.1 time: 0.083693 Jun 21 17:02:21.896382 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 562/1146] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:02:21 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1513 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:02:22.913305 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:22.914148 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.compute.api [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124685) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:22.920711 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:22.921166 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:22.921950 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:22.922385 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:22.952766 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:22.953203 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG oslo_concurrency.lockutils [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:22.953673 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.objects.instance [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lazy-loading 'fault' on Instance uuid b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 {{(pid=124685) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 17:02:22.998362 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.policy [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e403ec2e4684b8eb884e9aefae351d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d08b848eb54ba9855407bcdef52d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124685) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 17:02:23.006433 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-86894eac-0e83-4339-8e55-756ba67747ea tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 200 len: 1349 microversion: 2.1 time: 0.097996 Jun 21 17:02:23.006995 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 585/1147] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:02:22 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 17:02:24.023861 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '>' {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:24.024488 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.compute.api [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] [instance: b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8] Fetching instance by UUID {{(pid=124686) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 17:02:24.031082 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:24.031521 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:24.032264 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 17:02:24.032692 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG oslo_concurrency.lockutils [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Lock "dd78fa9d-4a9e-4489-98e3-ab61d677bb6e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 17:02:24.046594 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.wsgi [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] HTTP exception thrown: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 could not be found. Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Request method failure captured: Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: request: GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 HTTP/1.1 Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept: application/json Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Accept-Encoding: identity Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Connection: close Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Length: 0 Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Content-Type: application/json Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Host: 10.222.0.70 Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Openstack-System-Scope: None Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: User-Agent: python-urllib3/1.26.9 Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Auth-Token: gAAAAABisfkTbM74Vrf_v4m9UahWPt78lsPiUJhJTe6pzWxtDHHFlUeIfN-CJ1xev3U5xVLgzRd7zXLaDZ2AHriWgeihdOtpEkQjGfq2PlRmZzSotF_njQIOR9zB0dju2Wy4pII-M8RwURxgB8xcoEfP5im8_f9Ju8UHFdTN6qLybzpbdOvMDEQ Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Id: None Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Domain-Name: None Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Identity-Status: Confirmed Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Is-Admin-Project: True Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Id: default Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Domain-Name: Default Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Id: 30d08b848eb54ba9855407bcdef52d14 Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Project-Name: tempest-TestMinimumBasicScenario-1550387160 Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Role: reader,member Jun 21 17:02:24.048227 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Roles: reader,member Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/30d08b848eb54ba9855407bcdef52d14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/30d08b848eb54ba9855407bcdef52d14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/30d08b848eb54ba9855407bcdef52d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_30d08b848eb54ba9855407bcdef52d14", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant: tempest-TestMinimumBasicScenario-1550387160 Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Id: 30d08b848eb54ba9855407bcdef52d14 Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1550387160 Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User: tempest-TestMinimumBasicScenario-1550387160-project Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Id: default Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Domain-Name: Default Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Id: 6e403ec2e4684b8eb884e9aefae351d3 Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: X-User-Name: tempest-TestMinimumBasicScenario-1550387160-project Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: method: > Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: exception: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 could not be found. Jun 21 17:02:24.050922 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: action_args: {'id': 'b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8'} Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: {{(pid=124686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 could not be found. Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 17:02:24.052087 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 could not be found. Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 could not be found. Jun 21 17:02:24.054011 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: ERROR nova.api.openstack.wsgi Jun 21 17:02:24.055892 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: DEBUG nova.api.openstack.wsgi [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Returning 404 to user: Instance b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 could not be found. {{(pid=124686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 17:02:24.055892 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO nova.api.openstack.requestlog [None req-604f5c8c-cb60-4bed-8f19-fd7aa1891138 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8" status: 404 len: 111 microversion: 2.1 time: 0.029677 Jun 21 17:02:24.055892 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: [pid: 124686|app: 0|req: 563/1148] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jun 21 17:02:24 2022] GET /compute/v2.1/servers/b7ea6ac2-8535-4e66-940f-a7e49a4a6ac8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 17:02:24.059175 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: DEBUG nova.api.openstack.wsgi [None req-0cffad99-0f86-49ad-8f1f-a57c58d01cd2 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] Calling method '.version_select at 0x7f0a435650d0>' {{(pid=124685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 17:02:24.145131 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO nova.api.openstack.requestlog [None req-0cffad99-0f86-49ad-8f1f-a57c58d01cd2 tempest-TestMinimumBasicScenario-1550387160 tempest-TestMinimumBasicScenario-1550387160-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1676541516" status: 202 len: 0 microversion: 2.1 time: 0.089523 Jun 21 17:02:24.145796 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: [pid: 124685|app: 0|req: 586/1149] 10.222.0.70 () {58 vars in 1271 bytes} [Tue Jun 21 17:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1676541516 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 17:03:41.223321 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 17:03:41.223920 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Tue Jun 21 17:03:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 17:03:47.223974 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 17:03:47.224597 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Tue Jun 21 17:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 17:04:57.337746 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 17:04:57.338355 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Tue Jun 21 17:04:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 17:05:24.935750 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 17:05:24.936554 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Tue Jun 21 17:05:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 17:07:01.231484 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 17:07:01.232093 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Tue Jun 21 17:07:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 17:07:07.232612 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 17:07:07.233396 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Tue Jun 21 17:07:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 17:07:25.696413 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 17:07:25.697011 dv-cinder-799871-21-iscsi devstack@n-api.service[124685]: Tue Jun 21 17:07:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 17:07:28.987769 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 17:07:28.988384 dv-cinder-799871-21-iscsi devstack@n-api.service[124686]: Tue Jun 21 17:07:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!